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This'Wcchhical report describes the development of 
€he College-Level Acacmfcic Skills Test (CLAST) , an instruments 
designed to measure Florida college students' achievement 6f the 



computation and communication 
their sophomore year. Section 
purpose, the requirement that 
arts degree or * upper-division 
of CLAST scores, and the test 



skills expected by the completion of 
I covers CLAST 1 s background and 
all students seeking an associate in h 
university status take CLAST, the use 
administration plan. Section II traces 
the development of < fcLAST, explaining 'the process of identifying and 
validating essential academic skills; the identification and review 
of existing tests; test and test item specifications; and the process 
used in item development, review, and analysis. Descriptions of CLAST 
and its computation, reading, writing, and essay subtests are ^ 
provided in section III. Section IV explains the developments of, CLAST 1 
forms, focusing on procedures related to the item bank development, 
test assembly, test instructions, quality control, and test analysis. 
After section V assesses CLAST 1 s validity, section VI reviews 
technical aspects of CLAST 1 s development, including calibration 
methods, generatiop of ability estimates, test equating, score 
reliability, item. bias prevention, and item analysis* Section VI I* 
explains scoring and 4 reporting procedures, and section VIII 
Summarizes 1382-83 CLAST administration rfesuLts. Appendices present a 
glossary, relevant laws, skills assessed, pro ject* tiembeps, arid CLAOT 
item review forms. (LAL) 
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OVERVIEW 



.The College^Level Academic Skills Test (CLAST) has been developed as a part 
of an overall effort In the State of FLoMcla to ensure nhat students have 
achieved the skills expected of them before tljey move - from one level of- 
Education to the nekt. m It is the particular function ok CLASX tt) determine the 
extent to which college students have achieved the communication and computation 
skills expected of all students by the completion of tneir sophomore year. 
* " • * % I 

~: In- -19 *9r-tM^or ida^egi^ 79j^Zfe 2 , I^ws Flor ida , 

charged the Department of Education' ('DOE) with responsibility £or maintaining a 
list of communication and computation skills •associated with successful student 
performance to the baccalaureate. -The- same legislation made/ the State Board of 
Education responsible for (1). approving the list of communication and 
computation skills, (2) approving tests to measures achievement of those skills, 
and (3) setting performance standards. / v 

The Department of Education, through the Articulation/ Coordina tin; 
-Committee, established the Col lege -Lev^J. Acadc 
cooperative activity of faculty members' from 

universities to identify and validate the skills and to identify testa^ which 
could be used to measure the skills. A faculty member served as the project 
"director, working as an adjunct to the staff of the Deputy Commissioner for 

Special Programs. » * / 

/ 

^tn 1982* the Legislature iri Chapter 82-180, Laws of Florida, directed the 
Department of Education to develop a test to measure student achievement of the 
college-level communication and* computation skills. That legislation required 
the use /of scores on the teat as a condition of eligibility for the award of 
either an associate of arts degree or admission to upper division status in a 
.state uniVersity. The College-Level Academic Skills Test is the test which the 
Department of Education has developed in response to that legislation. 
»■ * . ■ , • 

. o Appendix B contains copie's of statutes and rules which Are applicable to 
'the CLAST requirement. 



rticula tion / Coordinating . 
lie Skills Project as a 
Community colleges and state 



Purp ose of CLAST ' < ■ ; " 

The College-Level Academic Skills Test; has been designed as an Achievement 
test. It is intended to measure the level of achievement of the communication 
and computation skillfe which are expected of all students by the time they 
complete their, sophomore year in college , i*e., those which are listed in State 
Board of Education Rule 6A-10.31, FAC. 

Each of the fouk subtests of CLAST — computation, reading, writing, and 
j&ssay--has^^en-desighed to yield a single- score- which is a-valid and—reiiabie 
estimate of the achievement by individual examinees of the group of skills 
measured in that subtest.' 

While it is presumed that CLAST sc9res relate positively to other measures 
of academic .performance, both prior to and after the testVhas been taken, CLAST - 
does iiot purport to be a predictor of subsequent performance of examinees -in 
upper^division programs, nor is the test designed tQ yield skili by skill 
information needed for full diagnosis of. the problems of individual examinees. 



Requirement to Take CLAST 

v 1 - ■ * 

Beginning in Octobelr, 1982, any student enrolled in a public community 
college or university in! Florida who falls into one of these categories is 
required; to take CLAST: (1) community college or university student completing 
the Associate, of Arts degree, (2) community college or university student „ 
seeking Jadmissioo to upper division, (3) student enrolled in a state university " 
under the provisions of Rule 6A-10. 314(5) , FAC. 

To be. eligible to take CLAST during any gi,ven term* an individual must- make 
application to take the test on or before the deadline Established for that 
administration and must fall into one of the categories -of eligibility. 



Use of CLAST Scores * * 

• y 
The use of CLAST scores is governed by Florida Statutes and the^tate Board* 
of Education* Scores are required for the award of an Associate of Arts degree 
by a conimunity college or state university and for the admission of students* to 
upper division Status in a state university in Florida. Beyond establishing 
eligibiljity for those awards, use of CLAST scores prior to August 1, 1984, is 
limited to student counseling and cur riyulum improvement. 

Under current requirements of law, effective August 1, 1984, no Associate 
of Arts degree can be awarjded to any student whose scores on CLAST do not 
satisfy minimum standards whdfch are yet to be set by the State Board of N 
Education. For any term which begins after August 1, 1984, ho student can be 
admitted to upper division status in a state university who dloes not have 
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CLAST scores .which satisfy the minimum standards of the State, Board. 4 Students 
enrolled in. a 'state university under the provii ions of Rule' 6A-10. 314(5) , FAC, 
mfast present scores on CLAST which satisfy the minimum standards of the State 
Board during the first term of enrollment. : , 



'Test* Administration Plan 



5 



Under p rovisions of Section 229.5Sl(3)(k) , Florida^ Statutes, the 



Commissioner of Education retains responsibility for the administration of » . 
CLAST* * _ 1 ■ * . 

A plan for the administratioil of CLAST during the 1982-83 academic^^ar was 
issued by the Commissioner in April, 1982. Th^ plan was .developed by the 
Department of Education after consultation with» community college and iUniversity 
personnel* Under the plan, responsibility for the administration of CLAST was 
established at fthree levels, viz., the department of Education through the CLASP 
Office, the Statewide Test Administrator to which Administrative responsibilites 
are assigned, and the community colleges and state universities which administer 
the ^est to eligible students. The Office of "Instructional Resources of the 
University of Florida was selected for assignment of statewide, administrative 
responsibilities fc^ CLAST/ 

\ < ■ • - " • 

The test administration plan details, the responsibilities of the CLASP 

Office, the Statewide Test Administrator, and the local institution. It also 

describes the policies and .procedures under which the testing program operates*. 

The Test Administration Manual , 'which is made a part of the plan, gives 

additional specific information to' assist institutional personnel in carrying 

out their responsibilities. 



? 
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DEVELOPMENT OF CLAST s 

• * . - * <J' 

The. initial test development process began with the identification of 
the skills to be assessed and culminated with thla*test administration in 
October, 1982. This section of tjKe technical report provides detailed infor- 
mation about 'each of the major steps in the development of CLAST. A calendar 
of major events in^test development, is included below. 



CALENDAR jjOF KEY EVENTS IN THE , 
DEVELOPMENT OF THE COLLEGE-LEVEL ACADEMIC SKILLS TEST 



FS 79-222 Enacted, ^Requiring Identification 

of Skills . . : . .. . . . " Spring 1979 

v • - : . " k . 

EAST (now CLASP) Established . .U Auguat 1979 

Identification and Validation, of the Skills . . ; ; 1989 

Task Force' Report^ ..... V . . . r ...... . . . December 1980 

Test Search . . . .\. . . . . . i ... * 1981 

■ *i r -■ ' • - • ■ 

SBE Adopted Rule, 6A-10.31-.314, FAC Listing ' 

the Skills and Establishing the Test Requirement. .September 1981 

Development of N Test and Item Specifications . . . 'April-November 1981 

Review of Item Specifications .... . . v . . . s \ . . November 1981 

Refinement of Item Specifications December 198^ 

Development of Test Administration Plan January-April 1982 • 

Development of Items by Contractors . Januaty- April' 1982 

DQE Review of Items ......... ... . . .February, March 1982 

Field Test of Items June 1-4, 1982 

Analysis of Field Test Data " June-July 1982 * 

Development of First Form'of CLAST ;\ . . July-August 1982 

Administrations of CLAST 1982-83 ..... . .. . . October 23, 1982 

March, 19," 1983 
- June 4, 1983'' 



Identification and ValidatifrnVof Sktlljg ~ -* >,> ' v, 

The Articulating- Coordinating. Committee, charged^ by the Department of 
Educatipri with tk task of implementing that. part Of the legislation dealing 

>with idenfiif-ic^tid^ of ' skills and: tests to, measure achievement of tnose skills, 
established the Essential Academic Skills Project (now the Colleee-Level 

•Academic 'Ski %la Project) in &igust f . 1979. .^The. project accomplished -its goals / m 
utilizing* the Executive {praoiftte^ fot 't^tf Project /the Pro jefct Director, State 
Level Task Forced on Communications'" and Commutations, and the Standing Xommitt%e 
on Student Achievement. * Members' -af^ these groups are ^identified' in Appendix D- ; 



% To genetrate the list of ^kil^ls, the Stat? Level Task ^Forces, fqfcether with 
the Project Director, an^ other project personnel acting in an advisory capacity,^ 
worked through a Series *f meetings fr^ January to" November of 1980. Members 
Interacted, "witli iiisb^tutiorial-level task- forces, „ which had been established to 

* involve, faculty members in .Florida 1 s public, universities and community colleges 
in thevJidentif ication of the. skills .arid pother project activities. 

This ^process' generated a list of 60* communication sjcills in reading, ,♦ 
writing, glistening , f/ rad sp , eaking f and 65 computation skills in the areas of 
algorithms, concepts generalizations, and problem solving. * A sutvey was 

. developed tp meastfre the extent of faculty agreement that thevskills identified 
should be acquired by all students*' completing* their sophomore year in Florida 
public post-isecondary ins titdtions. The survey was distributed to a random 
sample qf 837 faculty members draijrn from* broad discipline areas. . A tota]>of 348 
community college' and 214 university faculty, members included in the sapple 
responded to the survey. Additional ipput on the skills was obtained from other 
faculty members sufficiently interested .in *he competency idientif icatipn. process- 

'.to complete "vol^arE^r" surveys. " f * ' 1 

The result^ of the surveys were; used in finalizing the list of sjcills to T)e 
recommended to" the State BbartJ of. Education. For the 60 communication skills 
the percentage of agreement that "every* student regardless of major, Shoulji havs 
acquired this skill by; the end of the sophomore year" ranged from 70 to 99 

* percent. The^ Communications Task Force v recommenced that all the communication 
skills be retained on the final list to be submitted to the Board. For the 65 
computation skills, the .percentage of agreement ranged from 36 to 98 percent. 
Based on these results, the Computations flask-Force recommended that 56 of the 
65 skills be retained oh * the : final list to be submitted to the Board. 

t In September, 1981, the Board of Education adopted Rule 6A-10.31, FAC, 
which includes a list of the . 59- communications and 56 computation skills 
accepted by the Board. One skill in the a^rea of listening was deleted frjm the 
list because it could L not be"*clearly operationalized. The skills- listed in the 

* rule are expected of /Students by . the end of the sophomore year in ^o liege* 
( Table 1. shows the hierarchy of /sfcills. ' Riile 6A-rl0.31, FAC, contained in 

Appendix B, lists the'll5 skills adopted ; by,the Bo.ajd. Detailed reports of the . 
identification and validation of skills, including the survey and tabulations of 
the responses, are contained lit the following reports: 

Essential Acaoemic Skills focJFlorida Community Colleges and U niversities, 
Part 1: Interim Report of the State Levtel Task: Force- on Com munications and 
Computations , September, 1980. t A 
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Essential Academic: Skills. .. .Part II: Institutional Survey Questionnaire, 



Sep tembety. 1980. 



/ 



Essential Cotmnuqications and Computations Skills .in Public Cptftmunity 
Colleges and Universities in Florida , December, l^po. 



These reports were published -by the Florida State Department of E<Juca£ion 
and are available from the CLASP Office of tie DOE, * • . >% 



TABLE 1 



Classification of Skills 



COMMUNICATIONS 


I. Readinj^^ 


II. Listening 


III. ^ititfg 0 


IV. Speaking 


A. Literal 
Comprehension 

B. Critical 
Comprehension 


A. Literal 
Comprehension 

B. Critical • 
Comprehension 


^y/^Composi tion 
of Discourse 

B. Transmission 
of Discourse 


A. Composition 
of Message 

B Transmission 
of Message 


11 


Number of Skills W 
13 


ithin Each Area 
24* 


11 




COMPUTATIONS 


I. Algorithms 


II. Concepts ' 


III. Generaliza- 
tions 


IV. Problem ♦ 
Solving 


A. Arithmetic 

B. Geometry /£ 

C. Algebra ' 
Du Statistics 

E. Logical Reas. 

F. v Computer Tech. 


A. Arithmetic 

B. Geometry/ 

C. Algebra, 

* D. Statistics 
E. Logical Reas. 
F ? Computer Tech* 


A. Arithmetic 

B. Geometry 

C. Algebra 

D. Statistics 

E. Logical Reas. 

F. Computer Tech. 


A. Arithmetic 

B. Geometry 

C. Algebra 

D. Statistics 

E. Logical Reas. 
F> Computer^ech. 


;. ' r 

./'.. 13 


Number of Skills W 

.. y " . 'J ' 

25 > 


ithin Each Area 
f 

9 - 


' 9 



Test Sear eh - 

Once the 'skills had been Identified, the Standing Cotnmitjtee on Student 
Achievement,* with the assistance of project staff, began its (task of identifying 
tests and other assessment procedures which could be used t^ measure achievement* 
of the skills. To accomplish the task, an extensive search was conducted' to 
identify commercially available tests and tests developed by community colleges 
and state x universities which might be appropriate for measuring the achievement 
of ^communications and computation Skills. - Sixty-six tests *£n the area of 
communicatidns and 54 tests in 'the area of computation were reviewed iti depth. 
Though all of the tests addressed some of the skills, none was judged adequate 
for measuring all of the Skills identified in Rule 6A-10.31, FAC. 
* 

A more detailed report on the test search, Test Search and Screen for 
College-Level Communication and Computation Skills (Department of Education, 
May, 1981) is available from the CLASP Office. 



Development of test Specifications 

Specifications for a test which could be u§ed to measure the 'achievement of 
the skills listed in Rule 6A-10.31, FAC, were developed between April and August 
of 1981 by the project director and staff. The test specifications were 
developed with assistance from members of the Standing Committee on ; Student 
Achievement** Communications and Computation Task Forces, and measurement 
consultants. Recommendations, on the assessment of the skills submitted by the 
State Level Task Forces, as well as practical and measurement issues, were, 
considered in determining the nature of the tasks and the njpber of item$ for 
each subtest* General specif icatifeqg which werd developed ffiv the test are 
shown in Table 2. ' > ■ • » 

The specifications called for the development of multiple-choice items for 
measuring reading, computation, and 14 of 24 writing skills. A writing sample 
(expository essay) was recommended for measuring levels of performance on the 
entire set of writing skills. Decisions wer£/made to include all skills in each 
form of the test, rather than to randomly select among skills. It was also 
decided tp include experimental items in the test forms so that data needed to 
select items for Subsequent test forms could be generated* Later, some 
modifications were made in the test specifications. The number of raters for 
the essay was reduced from threpr to two, with a referee for non-contiguous 
splits only. Additionally, the time allowed for the commutation* subtest was 
reduced from 105 to 90 minutes following the October administration since more 
than 95Z of the examinees completed the test within 90 minutes". 



Development of Item Specifications 

• * 
At the time the State Board adopted the list of college-level communi- 
cation and computation skills, it directed the Articulation Coordinating 
Committee of the Doe (through Rule 6A-10.311, FAC) to develop item / 
specifications which would be used in the development of a test to measure 
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student attainment -of the skills. When it became appajrejtt that priorities among 
the skills would have to be established for a test to be ready to administer in 

jiOctobee; 1982, priority was gJLven to riie four skill areas which were included 
in the 1982-83 version of CLAST, viz., communication skills in read ins and 
writing, and computation skills in algorithms and concepts. These skills aire, 
listed in Appendix C During the Tall of 1981, item specifications for the 11 

/ reading, 24 writing, and Z(t computation skills were written by. the chairpersons 
of the state level : task forces, with assistance from content and measurement • 
consultants, members of the Ti^kT Forces, members of tlfe Standing Committee and 
the CLASP staff. Faculty members from community colleges and state universities 
served as the content and measurement reviewers'- and are identified in Appendix 
D. * 

the item specifications were used by item writers as guides for it;em 
content and format. Copies of ""item specifications were distributed for use in 
all 37 community colleges and state universities jtb aid faculties in planning 
for instruction and assessment* of the skills. Copies of item specifications are 
available in the institutions as well from the ClJASP Office. 

Item Development, Review^ and Analysis ^ 

Item Development . In October, 1981, Requests for Proposals ^or developing 
test items in the areas bf reading, writing, and computation for the. 
College-Level Academic SkillsKTest were ..issued by the Department of Education. 
The RFPs contained detailed^Information about th^ tastofL to be completed, 
procedures for developing and reviewing items, and qualifications required of 
the contractor, item writers, and item reviewers. Eight proposals were received 
from three state universities, one community college, am* one private 
corporation. Based on the cost proposals ^and quality of the proposals, the 
following contracts for item writing were awarded in December, 198,1: 

Reading Items ' % University of Florid^ 

Writing Items & Essay Topics University of Florida 

Computation Items ' University of South Florida 

Items developed under these contracts were used in the 1982-83 forms of 
CLAST. Ptoject managers, item writers, ahd item reviewers involved in* the 
development and review &f items for th^se forms ar^ identified in Appendix D. . 

The following procedure was followed in developing the items: 

■ 

A. Item writers and reviewers attended training sessions which 
included discussion of test security issues, purpose of CLAST, 
use of item specifications, characteristics of good test 
items, bias issues, and specific assignments. 

B. Initial drafts of items were written and reviewed internally by • 
other members of the item-writing teams. 

C. Items were then pilot tested, and the results of rte pilot test 
and suggestions from other item writers were used in revising 
the items. The pilot test involved administering items to at 

^ / least thirty students, and interviewing five of those to obtain 

in-depth response data. 

ill • - — r 
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D. Revised items were then reviewed by the contractor,' s review 
team, whoJjad not been involved in the item writing 
phase, i£ttention was given to content, measurement, and bias 
concerns. ' 

Input froip thes^eylewers was u&ed in revising items 
prior to submi£%iafe the items to the CLASP Office . 
of the DOE. . r • 



Department &i Education Review of Items. . Prior to accepting the i'tems as 
meeting the requirements of thje contract, the nOE scheduled an independent \ 
revMw which involved community colleg<5 and university faculty who had no^: wen 
involved in the development of .the^l^ans. * ; t * • 

The purpose of the review waq to insure that the items met the^ 
specifications, and were judged to be appropriate for -measuring the Skills, and 
were f ree -af^^s^a^d other confounding factors. , Reviewers -were individuals 
with expertise In the content areas and measurement. J 

Sample review ' tpjttfa which were used by the^reyiewers in evaluating the 
items, are contained Iff Appendix E. The questions contained in these forms 
illustrate the kinds of concerns which were addressed in the review. 

• . » I 4 

Following the DOE rftview, the contractors made final revisions in the items 
and submitted camera^ready copy to the CLASP Office. 

field Test and Analysis of Objective Items . In June, 1982, a field test of| 158 
communications and 140 computation items was conducted in order to evaluate><he 
test items which were being^ considered for inclusion in the initial forms of tfee 

.test. The purposes of the field test were to gather information about the 
performance of cbllege sophomores on test items, to analyze the performance of 
individual items, and to establish the difficulty of each Item on a eommon 
scale. Twelve forms of approximately 33 items each were administered in 16 
' community colleges and four universities to a total of 2733 students 
(approximately 228 responses per item). 

The data were subjected to a classical item and test, analysis which yielded 
for each item: the percentage choosing each option, the item p-values 
(difficulty), and the item .point-biserial correlations with total scores 
(discrimination indices). The analysis also produced the following statistics 
for each of the twelve forms: a frequency distribution .of scores, the number of 
students taking the form, the mean and standard deviation of scores, and the 
KR-ZO reliability coefficient. 

The data were also analyzed using Rasch statistics generated by a modified 
BICAL program. Both item difficulty values and fit statistics were examined for 
the field test items. Ten linkinj^items in communications and ten in 
computation constituted /the commolj'item set for the twelve forms. Item 
difficulty values from the different forms were adjusted to a common scale using 
the set of linking* items. \ 

v 16 - 
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The classical* and .Rasch item statistics were used in determining whether 
items should be' included in the item pool JfSfr which the 1982-83 forms would be 
developed. Items were screened based on the following criteria: p-value 1.40, 
pdint-biserial 2 .30, all options selected by some examinees, and Rasch total f f 
fit <1.00 + 3 standard deviations. Items which w$re failed, to m^et the screen- 
ing criteria were reviewed to determine whether they appeared to be dysfunctional 
or whether some, other f actor. jnay.Jiave accounted for the failure to meet the 
criteria (e.g., the skill itself may have been judged to be very difficult or * 
item variant e may have effected the point-biserial) . Empirical data of thirf n 
type is used for identifying potentially dysfunctional' Items , not for selecting 
itemf • The primary criterion for selection of items is # the judgment of 
reviewers that the items meet the specifications and ^are appropriate for 
measuring the skills. * ' 

Field Test and Analysis of Essay .Topics . Ten of tfcirty essay topics developed 
for CLAST were field tested .in three state universities and five community 
colleges in Junej|ti982. A tgjtal of 862 essays werfe written, scored, and 
analyzed . 4 

* Each ^ssa^ generated from the field test was scored by two readers, using a 
~ holistic approach. A four-point scale was used in assigning ratings to the 
essays. The descriptions for each rating and the procedures for the scoring 
were developed as part of the contract with the University of 'Florida for 
developing objective writing Itiems and essay topics. x 

For each topic, the following data were generated: distribution of Scores, 
total number of essays written, number of essays written off the topic, mefen and 
median scores, percent of complete agreement between raters, percent of agree- 
ment within one score point, Coefficient Alpha with and without the referee, and 
reader comaents. 

Topics were evaluated in terms of ^their clarity, relevaride and appeal to 
thy target' population, suitability foe expository writing, and absence of 
biasing effects. Student and reader comments on the topics and performance data 
ytfre used in the selection of the six topics to be included in the 1982-83 forms 
of CLAST. V i 
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DESCRIPTION OF CLAST 



198? -1983 



The 19J82-83 forms of CLAST consisted of fouif subtests--computatioti, 
reading, writing, and essS^. Following is a brief description <^f each subtest? 

j:0MPUTATION - The computation* subtest" included multiple-choice items in" 
the areas of* arithmetiq, algejbra, geometry /measurement* 
statistics/probability, «and iogical reasoning. C 

READING - The reading subtest ipcloided multiple-choice items which 

measure skills in the areas of literal- comprehension and 
critical comprehension. Literal comprehension included 
items that measure the ability to read for specific • 
h information contained in Reading passages. ' Critical 
• * comprehension incAided itemds, that measure the ability to 
% - . ' make inferences or judgments about what is read. . 

WRITING - Writing skills in 'the aseas of word choice, Sentence* 

structure, and grammar/ spelling/punctuation wtere measured 
, by multiple-choice items* W^rd choice items measured the 

ability to choose words which convey the specific meaning 
required by context. Sentence structure items measured ; 
the ability to identify the sentence structure, tttat. 
most clearly and effectively expresses the thought. 
Grammar, spelling, and punctuation items measured 
knowledge of the conventions of standard American English 
grammar and. usage/ K 
i 

ESSAY - This subtest required the examinee to choose one of two 

topics and write an expository essay. The essay measured 
the ability to write' a composition, provide idle as and 
information suitable tcr the purpose and audience, anil 
use effective language which conforms to the* • i 
conventions of standard American English. - t 



The number of items by subtest and by bro 3 ad skill areas within each 
subtest is shown in Table 2* ' Alternate ' formf of the test whictnmet these 
specifications were "developed for each administration* * 



The test consisted of two books—one containing computation items ^nd one 
containing reading and writing-ait ems, and instructions for the essay; In order 
to increase test/security , multiple forms of each test were printed for each* 
administrations' In addition, braille and cassette versions were available. 



Testihg Schedule . The test wag administered in one morning session, which 
required approximately four and one-half hours.* Actual testing time was threte 
and one-half hours, plus time required for checking in examinees-, coding 
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identifying information, distributing and" collecting material's, reading 
directions for each subcfesfc, and a ten-minute break. The order of 
administr#ticfti and testing time for the .computation subtest \ere Revised' 
following, the October administration.' ^ The order in which subtests were v 
administered in Ma ret* and June and the' time allowed for" completion of each 
subtest? j.s shown below. > * * 



Essay" . . 
"Writing and Reading 
Computation - y. : 



50 minutes 
"70 minutea* 
90 minutes 



Modifications in test format, testing schedule^ and administration 
procedures al^tt^cl for handicapped examinees are -detailed* in the Test 



Administratis 



inual.i 



. V TABLE Z 
TEST DESCRIPTION FOR* 1982-83 



BOOKLET I 



Skills 
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Essay Writing Sarnie 

0 4-6 paragraph essay 
on a selected topic. 

It- 



Skills \ Writing Subtest 

*\Broad S kills Area .. 

f • . . : ' 

3 Word Choice 

5* Sentence Structure 

6 ' Grammar, Spelling & 

Punctuation 

Total Items 



Topics 

• 2 s. 

Totsl Items 
6 

10 
20 

36 -V 



' Scored Topics New Topics 



Scored Items 

; " Jr 5 • 
8 

. ■■ - 16 



29" 



New Items 

1 
2 

■ • : 4 



Skills Reading' Subtest 

■ "■ Broad Skill Area * 

3 '.' Literal Comprehension 12 

8 Critical Comprehension .32 

, Tatal Items 44 



10 
26 

36 



BOOKLET .2 
Skills 



6V 

9 

7 

7 

6 



Computation Subtest 
Broad Skill Areas 

'Arithmetic 1 10 

Algebra t '[ 16 

Geometry & Measurement 12 

Logical Reasoning 12 
; Statistics/Probability * 10 

Total Items 60 



8 

13 
10 
10 

J8 

49 



2 
3 
2 
2 
_2 

11 



Appendix C llsts^ the specific "skills Included in each area tested. 

19 
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DEVELOPMENT OF CLAST FORMS 



The development of new test *forms for .each administration fallows the 
procedures described below. Items are drawn from the item bank and formatted 
into test booklets. General and specif ic ^instructions are included to assist^ 
students. Each test form tjtien is subjected to a series of reviews prior to and,/ 
tollowing the test administration. • 



Deveiopm^fitjaf the Item Bank ** - v <jf 



As items are developed, they are numbered with a nine-digit code that \ 
identifies the subtest, skill, sequence number, and graphic. These items are 
stored in a card file that is updated^as items are revised. New items are adde<t 
to the bank following the. review of the experimental items from each 
administration. < ^ 

' A history and attribute computer, file is kept for the 'item bank. This file 
is used in the selection of items for test forms and in the* test analysis 
process. The file in<*lu^es -attributes such as the item code, broad skill code, 
item flag, date used, and test "form, Statistical d*£a include the percent 
correct; item point-biserial coefficient; ahd N Rasch difficulty) fit statistics, 
and % index of discrimination for each item. Data on each item are *ept in the 
active file for six administrations. After that time,' a hard copy and a tape 
record are stored. The [computer ^nk is then rotated to remove the data from 
the earliest administrations. / 



Test Assembly 



For each administration items are drawn from the it^-M^ik to meet the |ted^ 
specifications. A twenty-percent overlap of items be t*£en forms is used to 
equate the test, forms. The remaining items are selected to minimize the 
difference in difficulty between forms'/ Current item difficulty values are used 
in the item selection process^ * Test form item difficulties are centered near 
zero logits. Small variations in mean difficulty o<xcur^ particularly in the 
reading test where items are tie^to specific passages. r. Alternate forms are 
adjusted to the common .scale by €ne equating procedure^ 

The plan for the format. an<f arrangement of items In the test forms is 
intended to make each fonn attractive and easy t'd read. Objective writing items 
are grouped by format^ and content to make the testing time efficient for the 
students. 

Test Instructions 

7 ■ • % 

The general instructions give information about scoring, recording answers, 
number /of items,, and time allotted for each subtest. Directions state that 
scores/are based on the number right with no correction for guessing-. Fixed -J 
time* limits are set for the essay, reading/writing subtests, and computation 
•subtest to facilitate the administration of the test. However, these limits 
allow at least 90 percent of. all examinees to complete each subtest. 
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Within the test specific instructions may precede groups of items or 
individual items- Ttiese instructions alert examinees to changes in item format 
and assist In clarifying what is required to respond t^o the^ifems. 

I 

Quality Control / 

Trie consistency of quality of test foAns is- main£aine£ through an extensive 
review process- Drafts of new test forms -»are" reviewed by staff in. the s — 

contracting* agency and in the Department of Education. After changes in J$*os 
and corrections are made, there is a second review >of camera ready copy; Then 
when final review of the proof copy is completed, a gi;oup of faculty sit the 
examination to verify the scoring key. 

Following the administration of the test a preliminary item calibration and 
item analysis are performed on tests that arrive early for scoring. Results of 
these analyses are screened for possible. misprints, item flaws or key errors.* 
k Clues to these errors are low discrimination indices or Rasch fit 'Statistics 
that l>ave high values. Other indicators of problems are lack of balance in foil 
distributions or inordinate difficulty. It^s that exhibit these 
characteristics are flagged, >and following a CLASP staff review items may be 
excluded from scoring. ,■•„■-« 

The pretesting' of new items which* are embedded in the test forms is another 
form of quality control. Before an item is added to" the' bank, it is pretested 
as d non-scored item, and its item statistics are reviewed. Itemp which do not 
meet the item selection criteria are examined to determine whether they are / 
adequate measures of the skills. Any scored or rton-scored item^rh^ch is revise^ 
is resubmitted as an experimental item, and item statistics f or Hfl*e revised itfaa 
are reviewed prior to its use as a scored item./ ^ / 

Test Analysis * 
■ ■ 

A teat analysis is prepared for each administration as a final step in the 
test develojfjgent process. This analysis is used to evaluate tfie entire t£8t to 
determine its^overall quality. Aq_ itan selection report is prepared an<J 
statistical analyses are conducted £0? the reliability of subtests, the 
item-total scdre correlations, and distributions of responses for particular 
examinee groups. These analyses include responses of all students-^or every 
test form. , • 

, Additional information about the performance of the test is taken from the 
institutional test administrators 1 and supervisor* 1 reports and on-site visits 
to testing c^Sters by Department of Education personnel. Theise reports provide 
information Sou t the quality of test booklets, jAe* standardization of the test 
administration and the adequacy of the allotted testing time. Based on this 
information, the format of the test booklets has been revised, and the testing 
time has been altered to imprpve the test administration. 



VALIDITY OF THE CLAST . 

The College-Level Academic Skills Test has been designed to measure 
achievement by college sophomores of specified communication skills in the areas 
of reading and. writing, and computation skills/ in the areas of -algorithms and 
cpncepts. These ski-lls are listed in Rule ; 6A-10.31, FAC. While it is presumed 
that scores on CLAST will relate positively to other measures of success in 
college, both prior to and subsequent to the examination, CLAST does not purport 
to predict grade point averages or other measures of success. Rather, validity 
of the teat Jrestd upon*th£ extent to which CLAST adequately measures the , 
specific- skills which it is designed to measure; that is, the extent to which 
the content of the test matches the set of skills. The validity of the test is 
'established by following the plan and ^procedures for developing and selecting 
items for each form of CLAST. 

The general plan followed in developing the test is outlined below:. 

* !• General test specifications, consistent with th£ purpose of CLAST, are 
developed by faculty who have expertise 4 in both testing and the content 
areas (reading, writing, and computation), with assistance of the CLASP 
* ; staff. p 

o 

2. Item specifications, which detail both the content and format of the 
items which can be developed to measure each of th& skills, are 

4 developed by faculty with expertise in. both the content areas and 
testing, with assistance of the CLASP staff. 

3. Test items are written by faculty according to the guidelines pro- 
vided by the itenj specifications, and are reviewed by faculty and ' 
CLASP staff with careful attention given to content, meaSurement, 

and bias issues. 

/ •/**"' 

4. ; Test Items are field tested in community colleges and state 

universities. 

« fr, J ' . • 

5. Items are analyzed statistically* and selected for use in the test 
' only if they meet criteria established' by the .CLASP staff and 

testing consultants. „ 

6. A test plan fbr selection, of* items is followed in developing alternate 
forms of the test. 

7. Scaled scores which are equated to the reference scale are 
generated using the Rasch model* 

To summarize, validity of the test as a measure of achievement of the 0 , 
skills is established by following the plan for developing and selecting items. 
Content and testing specialists judge the adequacy of the items for measuring 
the skills, and the plan for selecting items ensures that each form of CLAST is 
representative of the domain of skills being tested. -Scores on each of the 
subtests, then, can be interpreted to be valid measures of the students 9 , 
achievement of the communication and computation skills which are measured by * 
CLAST/ " * 

■ ^ ■ : 17; . • 
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, : . * " TECHNICAL METHODS . ' 

In -order to preserve t?he comparability of scores from one administration 
to another, tests must be parallel in content, and the scales must be equated. 
The methods used to accomplish these requirements include both traditional test 
analysis procedures and Ifcsch model procedures. Both contribute to the quality 
of C1AST and are described in this section* / • 

"■ The CLAST scale development Ms based on the logistic response of 
Georg Rasch, pre£e^6ed irr Probabilistic Models £gom Some Intelligence and 
Attainment Tests , I960, Rasch describes a probabilistic model in. which 
the probability that a person will answer an item correctly is assumed to 
be based on the' ability of the person and the difficulty of the item. These 
estimates are derived independently and ar^Jn^U-rtlat«d tQ the. particular 
sample of people or of items. When the assumptions af the model are met, 
tests of unequal difficulty can be equated. ** ■* 

*• * 

Rasch model estimates of person ability and item difficulty are obtained 
using the unconditional maximum likelihood estimation procedure described in 
Wright, M$ad, and . Bell, BICAL: , Calibrating Items with the Rasch. Model ,. 1980. 
The probability .of a icore is expressed as w 



P(X . B ,6.) - 
vi v* i 



/ exp [X ,(B -6.)] 
r vi v i J 



1 + exp ]fc v - 6 ± ] 



wfiere X . - a score,* B - person ability, and 6. - item difficulty.' 

> vi v ' i ,* 

Pe»son ability in logits represents the natural log odds for succeeding on 
item? which define the scale .tjrig in, and the item difficulty. Jh logits repre- 
sents the natural log odds %ot> faiJLure on an item by persons with; abilities 
at the scale origin. 

Calibration of Items 

Item difficulties are obtained' by .calibrating the scored items for 
each administration. Thr^jfe systematic random, samples of 700 records are 
drawn. The items are calibrated, and the item difficulty logits are averaged 
from the three calibration samples. Using the averaged difficulties, the 
item logits' are adjusted to the October, 1982, .base scale by the method 
explained in the test equating section. ^ 

♦Item history records are kept in a computer file and updated after 
each administration. The stability of Rasch difficulty, discrimination and 
fit statistics is checked, and items that change values by more than .3 
logits are flagged for further examination. In addition, items are re- 
ifltamined following each administration against the same item screening 
criteria used before the fit ems are administered as ^cored itfems. 
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. $ ^ Newly develbp'ed^or revised items are embedded within each form of the test, 
ani^hen-calibryateld: and adjusted to* the -base scale. These items are not counted 
toward examinees 'vicores and ax& not included^ in the initial calibrations which 
are used to /de^elojr the score scale. After the score scale is create^, each 
test form is recalibrated with both the new and the scored items to estimate 
item difficulties.'. The scored items serve as a link between the new items in 
each test fotm. Item difficulties for the new items' are adjusted to jthe base 
scale using the linking constant derived from the calibration of the scored 
items. For a complete discussion of the method sep Ryan, J. Equating New Tesf 

' Forms -to., an Existing Test , 1981. > ' 

Generation of Ability Jlstimates " 

° * ■ 

Trie traditional, estimate of achievement level is the raw' score ob- 
tained from the number of .correct answers provided.* ./The Rasch model is used 
to generate ability estimates which correspond^to the^traditional test score • 

■ » i j 

The adjusted item logits obtained in item calibration become the basis for 
estimating the person abilities. Generation of the ability estimates results 
in a logit ability scale which corresponds to the Iqgit difficulty scale of 
items, the Rasch ability logits are derived using the unconditional maximum 
likelihood estimation procedure of the program ABIL-EST (Ryan, F981). - 

. The ability estimate that corresponds to each raw score between one point 
and the number of items minus one is calculated. (Perfect or zero scores are 
'hot included in th^ Rasch calculations.) The ability 'logit scale is then 
centered at the mean for the October, 1982, administration, and transformed 
to the standard score scale via.t^st equating. 

Test Equating .3.1 

Equating tests gives meaning to the scores over time. Using Rasch 
methodology, it is possible to place scores from tests of unequal difficulty on 
'the same scale. While the CLAST .difficulty is controlled by ^selecting items 
which have approximately the same average and range of difficulty for each 
administration, some fluctuation in difficulty may occur in order to use items 
that represent a broad range of content and difficulty. Test forms are linked, 
by common sets of items to control for differenceis in difficulty. , ■ ' 

The linking designator CLAST includes a twenty percent overlap of items 
between administrations. Tests from the first three administrations wereKlinked 
with subsets of items in the base form. These linking items are a proportional 
representation of the content areas within each subtest. The difficulty of the. 
links represents a range of easy to' harder items. Item calibration values 
of the linking Items are avetaged and subtracted from the average difficulty . „ 
of these items in the base year to obtain the linking constant. 
- * / 

For each administration, CLAST'item difficulties ar^adjusted to the 
^base scale established with the October, 1982, administrat ion. The item 
logits obtained from the calibration of the scored items are adjusted by 
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adding the linking constant to~each logit.. The difference in average 
difficulty represents the shift in overall difficulty between test forma. 
This constant is addetf to the current item logits* to adjust them to the 
base scale. *-The .stability of the link ''is evaluated, by comparing the diffi- 
culty values of the linking items - over time to the values in the base scale. 
Stability is maintained, by linking tk the- base scale and £0 one additional* 
examination in a three-way linking design. . * >v A - 

Reliability of Scores . ("'■ - \ y\ 3 

. V ^ V- * ' - . o'v ••';;•;:> ■ . . ■ 

Reliability is an indicator of the consistency in measurement of student 
achievement. It provides an .estimate, of . the extent' of the variation in 
results that can be attributed to random error in measurement/ The in^ex of • 
reliability is interpreted as the ratio of-/true-score variance to observed- ">„ 
score variance. Reliability* is estimated somewhat differently for objective ; 
scores and essay ratings. The procedures used with each type of score are \ 
described in the following sections. ' 

Objective Scores . The reliability 6f objective subtest*- scores is estimated ; 
using the Kuder-Richardson Formula 2Q coefficient and the standard error of ' 
measurement. The KR-20 coefficient is an internal consistency estimate of 
reliability that was prp^osedl by Kuder and Richardson iri 1937. It is based 
on the concept that achievement on items drawn f rojn the same content domain 
should be related. She formula reported as the KR-20 is ' 



r tt . k-1 



where - estimated test reliability, s t 2 - .variance x^^aminees 1 total 
scores, k ■ number of test items,* and Zpq * sum of item variances. 

The KR-20 coefficient is appropriate for estimating reliability of scores 
for objective tests which are not highly skewed or truncated. Thp KR-20 
coeffi&^nts for the objective writing and reading tests^in particular 
are affected by the distribution of scores. For this reLon, the Staiidird 
e^pr of measurement is also reported as an indicator or reliability for 
each of the objective subtests. * Vi -" . 

The standard error of 4 measurement (SEM) represents the expected standard 
deviation of scores for an individual taking a large number of randomly parallel 
tests. ^ The mean of the set o£ scores would represent the individual's true 
scorfe. Therefore, the standard error of measurement can .be used to estimate 
confidence intervals arottod an individ ua l ' a true score . /Confidence intervals 
* applied to the obtained score are not symmet rical about the obtained / score,, but 
the estimated. true score is useful in obtaining the center for a confidence 
zone to be used with the obtained score. The smaller' the SEM, the less dis- • 
persed v are ,the parallel test scortes, and the more likely the estimate is close 
to the individual/s true score. 



The formula for .computing the SEM 'is 



)■ 



i 



SEM - s v /l^ 



where 
coef fic'len 



r s t - standard deviation Vf the test scores, and r tt » test^ reliability 
ic'ient. > . '/ . { . 



"yrKJrio reliaBility coefficients and ? the sftandatd errors of measurement 



objective subtests are reported in Talkie 3. 



TABLE 3 



Reliability of Objective Subtests 

1982*83 Administrations • >f 

; Reading ' Writing '* ' Computation - 

Oct. flarcl^ J ' June Oct. March June , Qct. • * March June 



KR^20 
SEM 



.87- .85 .85 
2.29 2.i9 2.25 



.72 .68 .69 * 
1.81^1.85 



1.81 



' .90 .88 .88 
2.84 2.98 3.01 



Essay Ratings . Reliability of essay ratings is' evaluated in several ways 
in order to assure that fhe raters rh^Cre; adhered to the established criteria 
for scoring assays. : Consistency in scoring is. maintained* by ^he training \ 
of raters and the monitoring of the scoring process-, and the reliability of 
th6 combined ratings is estimated by Coefficient Alpha. , Both procedures* 
are described below. . : , I 

Training prior to and during the .scoring is used to develop and main- 
tain the consistency is scoring of the individual: rater and the group of 
raters. The scdring process is monitored. by checking the assignment of : 
ratings, the number of split, ratings, and the distributipn. of ratings of 
each reader V To resolve scores which are splity all papers which^ are 
assigned noncontiguous scores are submitted to a referee and^ the $plit 
scores resolved. During and after eachtreading session, reader agreement 
data, which reflect the reliability of ratings are reviewed, Table 4 
summarizes the reader agreement data for the 1982-83 administrations. 



• * table 4 
/ Reader Agreement: 
October 



1982-83' 



Total Papery Read 
Non-Contiguous Scores \ ; 
Total Agreement • :\ ^ 
Agreement ^Wi thin One Point 



March 



N 


Z 


N 


X 


12369 


100 


-*9<J35 


100 


552 


4 


■ 739 


4 


6416 


52 


9707 


51 


5401 


v 44 


8589 


45 



June 



N 

10165 
420 
552& 
4425 



* 

100 
4 

.. 53 

•;' 43 



ERIC 



ERIC 



... ■ Reliability of the combined ratings for the essays is estimated by 
Coefficient Alpha which gives the expected .correlation between the cdtnbined 
ratings of the team arid phose of a hypothetical parallel team doing the same 
task. The formula for deriving this estimate Is 



Is, 



]. 



where r^ * coefficient -of .reliability • k - number of test items, - sum 

of . the item variances, and s * variance pf the examinees 1 total scores. 

The Alpha' coefficients by topic arid student category for the ratings of 
198Z-83 administrations are 'reported in Table 5. 

" * ;. ' . ' ' : :■' * ' • + 

. \ : ... ■ • • • . ' 

" . » \r Table 5 . 

Alpha Coefficients by Topic 



All Students 

• 'kale's 
Fejnales 
''>,;;• ^Whites 
r V flacks 
. Hispanics 
/Indian/ Alaskan 
Asian 

cc-aaJ' 

.,, CC-AS 2 
. Univ. Native 
Univ. Transfer 



Topic One 
With Referee 

Oct. March ^ June 




Topic Two • 
' With Referee 

Oct. March June 



79 


76 


80 


80 


82 


79 


79 


76 


80 


81 


81 


78 


79 


75 


78 


79 


. 82' 


79 


75 


72 


76 


76 


77 


74 


81 


76 


80 


80 


83 


75 


82 


77 


80 


82 


86 


80 


85 


84 


96 


81 


83 


79 


84 


83 


87 


90 


81 


85 


80 


77 


80 


80 


82 


79 


81 


78 


84 


81 


84 


78 


r 


79 






84 


76 




72 






78 


8.0 



Community college Associate of Arts students 

I " ' ' 
Community college Associate of -Science students 



Preventing Item Bias • 

Establishing the 'validity of an examination for all groups is \ contin- 
uous process that requires the documentation of the relevance of thejskills, 
the correspondence between items and skills, and adequacy of the test con- 
struction and review' procedures. Review panels were established at each 
stage of test development to consider the issue of bias in X est items.. Empir- , j 
ical data were also examined following each administration to screen for indi- 
cations that particular items operated differently for various groups. Scatter j 
plots of item difficulties, item statistics, and. frequency distributions of 
test scores were analyzed. Items identified, through these analyses were re- ,j 
examined to determine whether factors unrelated to the skills may have caused 
the differences in performance. 

The scatter plots which are generated contrast performance by racial /ethnic | 
and sex categories on individual items. Item difficulties, defined as the percept 
correct, are identified as outliers if the item difficulty dev iates J^swnt^al 1 * 
from the general relationship for the compared groups. Consistent differences j 
in item difficulties may indicate only a difference in the leve V^Ware { 
for the compared groups, but items that deviate from this general pattern are , 
further examined. Figure 1 is a sample of the scatter diagrams ^kt are produced 
to contrast group performance. 

0 FIGURE ^1 ' ' ' 

Item Difficulty Scatter Diagram 

* •5/09/13 * 

Site *%oSIS^ icmayio* p*tc • os/o»/»» cacacsm . „ „ _. O0 , f .«o* \ • 1 



Item Analysis 



Item analyses are reported for the total group of examinees and for each 
sex and racial/ethnic category. These analyses include foil. distributions, 
item point-biserial correlations, and percent correct. A sample item analysis 
is shown in Figure 2. 

FIGURE 2 
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Item Analysis 
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ITEM 


KPH1EE 


k 


8 


c_ 


m J> mm 


E 


J52I 


MULT 


DIPTICULTT 


1 


936 


1088 


7270+ 


989 


0 


87 




0,70 


2 


2679 


458 


5012+ 


2185 


0 


36 




0.48 


3 


1175 


1743 


1211 


6189+ 


0 


51 




0.60 


4 


7328+ 


1004 


629 


1165 


0 


45 


i 


0.73 


3 


2945+ 


1389 


3305 


2661 


. o . 


.71 




0.28 


6 


1833 


5630+ 


937 


1859 


0 


70 


* 0 


0.54 


7 


1614 


733 


7020+ 


963 


0 


41 


0 


0.68 


8 


724 


1472 


1423 


6694+ 


0 


57 


1 


„ 0.65 


9 


70 


80 


124 


10071+ . 


0 


24 


2 


0.97 


10 


78 


4132 


171 


m 5961* » 


0 


29 


0 


0.57 


XI 


300 


465 


1785 


7775+ 


0 


40 


1 6 


0.75 


12 


1513 


1823 


4068+ 


2926 


0 


39 


• 2 


0.39 


13- 


538 


8493+ 


190 


1127 


0 


23 


0 


0.82 


14 


737 


487 


6102+ 


3003 


0 


41 


1 


0.59 


15 


4602+ 
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INDICATES CORRECT ANSWER 
INDICATES EVERYONE GIVES CREDIT 
INDICATES QUESTION THROWN OUT \ 



SCORING AND REPORTING PROCEDURES . 

% 

The procedures for scoring the CLAST are designed to provide quality control 
and score scale stability for a testing program that has complex scoring and 
reporting requirements. Multipf^Tdministrations within a year and across years 
necessitate the development of alternate forms that must be equated. The process 
for scoring and reporting ^reflects the concern for the reliability and compara- 
bility of the scores and for* the appropriate use of the scores. 

* % 

Scoring Activities 

Editing Answer Sheets . Following each administration, as answer sheets are 
received from each institution, they are edited for errors. ' Answer sheets are 
read by an NCS Sentry .7018 scanner which has computer program checks built 
into the scoring process that identify mismarked or miscoded sheets. Each 
answer sheet identified by this process is hand checked and corrected according 
to the established conventions. 

Rating sheets for the holistic scoring of the essays are .also machine 
scored. Editing procedures for the holistic scoring include a verification of 
the legitimacy of the reader numbers and score codes. Papers with invalid 
codes or with ratings that differ by more than outpoint are returned to the 
referee to be corrected and/or reviewed. S 



Scoring Conventions . Within the parameters of number-right scoring, certain* 
conventions are observed: For a score to be considered valid, at least one 
response must be made on the answer sheet. Omits and double .marks are counted 
as incorrect. To be scored, responses must be recorded in the approptiate 
section of the answer booklet. To receive credit for the essay subtest, students 
must write on one of the two topics provided. 

• * * 

Students' subtest scores below the chance level are compared to their other 
subtest scores. If a score is inconsistent with the student's performance on 
the other subtests, it is hand checked to determine whether the form code has 
been correctly coded. g 

Generatio n of Score Scales 

A three-digit standard scaled score is generated for each administration' 
for each of the objective subtests. The standard score scale is a linear 
transformation if the Rasch ability logits adjusted for the mean of the, / 
October administration. The formula used is - / 

' ' ' * w ' J , ' 

' ' s i " 30 (X b - C) + 300 

% •' ■ * ■ / ' J 

.... . ( • ■ - . / : | 

where S± s scaled score, Xfc - ability logit, and C - October 1982 scale adjustments | 
factor. : / • .#j 



/ 

/ 



i 
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The score scale ranges from approximately 100 points to 400 points. 
The scale is centered at 300 points, which/designates the state average 
score on the October, 1982, administration. All subsequent examinations 
are equated to this administration. Differences in scaled score ranges 
across test forms occur as a result of differences in overall difficulty 
of test forms. The overall difficulty of . each form is controlled, however, 
so that these shifts in score range are small. Jf one test form is more 
difficult than anotheti it is possible to obtain a higher scaled score on 
the harder form because the harder form measures a higher level of achieve- 
ment. ■ • ' ^ 

-\ ■ ; • H; ' 

* The essay score is assigned on a senile of two to eight points. Two 
readers rateTeach essay on a rating scale from one to four points. The 
essay score is the sum of the two ratings. The holistic scoring procedure 
and rating scale are discUssed in the next section/ 

Raw score to scaled score transformation tables are* generated for each 
administration. The 1982-83 transformations are shown in Tables 6 and 7. 
The score conversion table for the March and June, 1983, administrations 
has a wider scaled score range than does the table for the October, 1982, 
administration. A procedural change was made for item calibration following 
the October administration when it became cilear that the scores were not 
normally distributed. The BICAL normal approximation method of calibration 
was used for the October administration. This method is appropriate for 
long tests and a Symmetrical distribution of. scores. The corrected uncondi- 
tional maximum likelihood estimation procedure of $ICAL was used beginning 
in March, 1983. The change in procedure primarily affected scores at the 
extremes of the distributions as shown in Tables 6 and 7. , 

* 9 
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TABLE 6 



COMPUTATION 



SCORE CON^JRSION TABLE: 
READING 



OCTOBER, 1982 



WRITING 
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21 
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23 
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28 
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31 
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TABLE 7 * ,'■ 
SCOBE CONVERSION TABLE: MABCH AND JUNE 1983 

:> 1 

COMPUTATION BEADING WRITING 
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Scoring of Essays - 

Holistic Scoring s Holistic scoring or evaluation is a process for judgirfg ttie 
quality of writing samples which has been used for many years by testing 
agencies in credit-by-examination, state assessment, and teacher certification 
programs, 

■ * "t 

' . Essays are scored holiatically— that is,' for the total overall impression 
they make on the reader — rather than analytically, which requires careful 
analysis of specific features of a piece of writing. Holistic scoring assumes . 
that the skills which make up the ability to write are closely interrelated * 
and that one skill cannot be easily separated from the others. Thus the 
writing is viewed as. a total work in which the whole is something more than 
^he sum of the parts. A deader reads a writing sample once, obtaining an 
impression of its overall quality, and then assigns a numerical rating to 
the paper based on his/her judgment of how well it meets a particular set of 
established criteria. CLAST essays are judged using the four-point scale 
described below. 

Essay Rating Scale 

V • 

The ratings reflect the four Igyels of performance that are described 
below: 

■V 

Rating 1: Writer includes very little, if any specfic relevant supporting 
detail but, instead, uses generalizations for support. Thesis 
statement and organization are vague and/or weak. Underdeveloped, 
ineffective paragraphs do not support the thesis.' Sentences 
lack variety, usually consisting of a series of subject-verb 
and, occasionally, complement constructions. 'Transitions 
and coherence devices are not discernible. Syntactical, 
mechanical, and usage errors occur frequently. 

Rating 2: Writer employs a limited amount of specific detail relating 
to the subject. Thesis statement and organization are 
unambiguous. Paragraphs generally follow the organizational 
plan, and they are usually sufficiently unified and developed. 
Sentence variety is maximal and constructions lack sophisti- 
cation. Some transitions are used ,and parts are related to 
each other in a fairly orderly manner. Some errors occur in 
syntax, mechanics, and usage. 

Rating 3: Writer presents a considerable quantity of relevant and 

specific detail in support of the subject. The thesis statement 
expresses the writer's purpose. Reasonably well-developed, 
unified paragraphs document the thesis. A variety of sentence 
. patterns occurs, and sentence construction indicates that- the 
. ' writer has_ facility in the use of language. Effective 

transitions are accompanied fey sentences constructed with 
orderly relationships between word groups. Syntactical, 
mechanical, and usage etrorff are minor. - 
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Rating 4: Writer uses. an abundance of specific, relevant details, 
including concrete examples, that clearly support * 
generalizations. The6is statement effectively reflects 
the writer's purpose. Body paragraphs carefully .fallow 
the organizational plan stated in the introduction and 
are fully .developed and tightly controlled. A wide 
variety of sentence constructions is used. Appropriate 
transitional words and. phrases and effective coherence 
. ' techniques make the 'pros* 'distinctive. Virtually no 
errors in syntax,, mechanics, and usage occur. 



A more complete description of the scoring process can be found in 
Procedures for Conducting Holistic Scoring for the Essay Portion of th *v 
College-Level Academic Skills Test , which is available from the CLASP Ofi^Lce. 



The holistic scoring session must be conducted in a highly organized 
maimer with competent staff members who have cledrly specified responsibil- 
ities. For 10,000 essays, the holistic scoring reading staff consists of 
a chief reader, 3 assistant chief read&rs, 20 table leaders, and 100 readers. 
A* support staff of a manager, 5 clerks, and an optical scannet 'operator are 
also required. . 

The scoring procedure follows this pattern:. Prior to the scoring session* 
the chief teader and his assistants sample the total group of essays to choose' 
examples from each of the two topics which clearly represent the established 
standards for each of the four ratings on the rating scale.. These essfcys are 
known as range finders. In addi'tion, other essays are chosen to be used as 
training materials during the scoring sessions. 

\ After the tange finders and samples are selected, the table leaders meet, 
with the chief and assistant chief readers to score the samples and determine 
whether the samples clearly represent the four levels on the scale. The / 
purpose of this session is to refine the sample selection and to assure con- 
sensus among table leaders. Range finders from previous admdt^str^tton? «e. 
also reviewed and used in the training to insure consistency in scoring f rdm 
one administration to the next. . / 

Immediately pritfr to and intermittently throughout the scoring session, 
the chiSf reader trains the reader % using the range finders and other samples. 
Immediately after the initial training session, the scoring begins. Each 
essay is read by two readers who assign a rating of "1". to "4." The readers 
are not aware of the identity of the writer of the essay nor of the score 
assigned by the* other reader. The scoring process is so managed that no reader 
reads the same essay twice. These two ratings ate summed and the essay/is 
assigned a total fecore between 2 and 8. In cases in which the two ratings are 
non-contiguous, *he essay is riead by, a third reader called-a rctfere*. TJie 
* rating given by the referee replaces the mpst divergent of the other two 
ratings. J 
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Recruitment of Readers , Each institution that jopr tic ipates in the College- 
Level Academic Skills testing program has an ojJportunity to participate 
in the holistic scoring process. The chief reader solicits nominations for 
readers from the chairs of English Departments in community colleges and 
universities which have lower-division programs. Nominations for readers are 
made 1 on the basis of the candidate's interest in the process,, willingness 'to set 
aside personal standards for judging the quality bf writing and undergo training, 
and availability to work over weekends. A candidate must have a minimum of ' 
two years experience teaching English, Composition, hold at least a Master's 
Degree or equivalent with a major in English in one or more degrees, and 
teach English Composition as part of his or her assigned responsibilities. 
Nominations may include secondary school teachers who teach dthhposition at 
the junior or senior .year level in high schools and faculty who teach compo- 
sition in private postsecondary institutions. 

Upon receiving nominations from department chairs, the chief reader and 
the CLAST statewide test administrator ask each nominefe interested in becom- ' 
ihg a reader t<* complete and submit an application form. The forms are used 
in determining whether applicants meet the criteria for readers. 

; J ■ " , . % . 7. • . \ 

Reporting , Test "Results 

The reports listed Wj.ow are. generated for each administration. In addition 
to these reports, institutions can generate their own reports and update files 
of student records using data tapes made available by the STA which contain 
student responses to all items. A test blueprint, which gives item-skill* 
correspondence, and the data tape format £re. provided ' cp the institutions. - 

Stqte Reports « ' \ ■' 

1. State frequency distributions of scores by (■ ! " 

' ' : ' " * '. ■ . • '■ * /.' '. . ■ \ . ■ ■• ' * f 

a. Student classification fc * 

„..'.. Community 'college A. A. program I 

Community college <A.S. program ( ^ - ( r 

University native student 1 , . ' 

* ' University transfer student . ^ I 

b. Racial/ethnic classification 



r 



White non-H|ispahic, Hispanic, black non-Hispanic, 
American Indian/ Alaskan native, Asian/Pacific 

inlander, and other, including foreign national % 
Females by racial/ethnic classification ' \ . Q 
Males by racial/ethnic classification y 
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2* State sunmary reports by 

a. Student classification 

b. Racial/ethnic classification 

... c*. Sex by racial/ethnic classification 
d. Regipn w .'..<■ 

3. State roster of examinees' scores , ' H 

4. "Statistical reports ' • 

a. Rasch item calibrations and fit statistics 

b. Scaled score derivations 

c. Classical item analysis by racial/ethnic classification 

d. Item difficulty plpts by sex and racial/ethnic classification jl 

ne. Interrater rel,iabiiity for essay scores ' ^ /, 

f. Coefficient Alpha by sex and racial /ethnic classification for 
. essay scopes y< 

g. KR-20 coefficients WndSEMs for objective subtests 

■■" ^ % ' . s ' ' , " ' ■ r .; ' - 

Institutional Reports * * 



1. -Institutional frequency distributions 



a. Student class if icdtibn 

b. Riacial /ethnic class if ication * ^ 
v c. Females by racial /ethnic classification ' 

d. Males by racial/ethnic classification 

2. Institutional summary statistics (means and standard deviations) by 

a. Student classification ¥ 
6. Racial /ethnic classif ication f . . * ' ■ 

c. Sex by racial/ethnic classif ication " " * | 

3. Institutional roster of examinees 1 ' scores ."V • .. 



Student Reports , Th4 individual, student report^ \i 
Interpretation ^ide/ f ?is mailed yfbtir tp slat week§ 



'which includes a score . 
after the examination 
dft.tp^ v ',A copy of the/ individual score report is shown, in Figure 3. Scale 
"scores are reported /for each subtest. Percent correct in each broad skill 
area is reported in the boxes to the right of the scale score pgr each- 
objective subtest, I For interpretation ^rpo.6es. f T the ^ 
correct is repotted to the student, littt. 1 ^ 

the student's transcript. The percent correct scores are intended "to help 
students, assess their relative strengths an^. wetnesses in the 3kif Is 
asieSs.^ "by * the test. ' ^ - iV J 
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Figure 3* 

Individual Score Report 
College-Level Academic Skills Test 

Date of Exa/J^ 



ss* 



INSTITUTION 



Following are your results for the College-Level Academic Skills tft The enclosed interpretatipn guide will help you 
understand your scores, 'The three digit numbers listed first in thelhree boxes below are your «b «^^««* 
subtest/ After ejch scale score you wilffind the percent of items you answered correctly for each of the broad skill 
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Interpretation and Use of Scores 

•• ' ' ; ■ ; • \. - ** ■•../..'■'■•"' ■ jv 

* \ " CLASH scores are. reported to indicate students 1 achievement of those ■ 
skills upon which the test\ r is based • The CLAST scaled scores for ^acK js^Tjtestj 
not the raw scores, are used for this purpose since the scaled scores haye 
^ been adjusted for differences in difficulty in test forms. A scaled"; sco*e of 
, 300, for instance, represents the same/level of achievement' across forms 'bo£ 

tmay required higher raw score on an easier test form than on a hardet ptie. : *, 
The same scaled score; theft, represents the same level- ;df ^achievement ofVthe^ 
skills regardless of the. test : fprm which was taken. ." ■ ;: : y-. ^ 

Haw score to scaled score. transfofma£i^ 
'are shown in Tables 6 and 7. ;;. \ 

Us'^fvrscpres eai?ned on CluAST during 1 982-8 3 was limit ed<&0 student 
advising and curriculum Improvement ^. ' Ifeder current provisions of Florida . 
Statutes, ef festive August 1, 1984, scp^/on t^sed 'to determine ^ 

whether student^. have met State Board ^.cjj|feclucation miftiium standards for the ' 
award of an Assbci^t^ of Arts degree "or admission to "upper division status. 

CLAST w^-no£ <deyeloped to predict success in upper" division programs, . j 
r but to assess the* level of acMevemeint of the skills listed^ in Appendix C. 
"Any use of the scores for selection of students for specific upper division 
programs must be empirically validated. 

; - * '•*.!,■ 
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•• ./v/r*" . : * SUMMARY. OF 1982 -^83 ^RESITLTS, ^ 

Results of the, 1982-83 administrations are" regbrted # in Table 8... ■ 



Table 8'. 
JSjuutokr y' of Resultif 



1982-83 Administrations 



READING 



Oct. (torch June 



WRITING 



,No. I teas 

Raw Scdre 
Mean « . 

Raw Score 
Std. Dev.* 

Raw Score" 
Median 



Scaled Score. - 
Mean : 300, 304 



36 34 34 

'ii:p V 2 A'° 25.0 

5.9 
300 



6.3- V/3T.6 



28 : 



28 



Scaled Score 

Std: Dev. , 27.6 r* 



Scaled Score , ../.'.■». v. 
Median .! 305 

Z Reaching End 

of 8ubteat ' ' 96 . 



:30» . ^ 302 



98 



97 



Oct. ' March June ' ■' 



COMPUTATION 



March June 



- ESSAY 
Oct. March June 



Examinees 12,377 19,050 10,375 12,363 19 



,052 10,376 12,391 19,t)4l 10,371$^ 12, 36? 19,035 10,365. 



29 


29 


29 


49 


23.6 


.23.9 


23.5 


33.9 . 


3.4 


3.1 


3.3. 


3.8 


24 


■' : 24 ~ 

. ■ ■ * 




3i: 


300 


307 


303 . A ; 


300 


23.8 


30.9 


30;7; ■■/ 


27.0. 


300 


301 


V301 


300 


9*'-; 


ft 


v 9 9 ■ . 


99 



49 



49 



31 



30 



301 298 



300 
99 



297' 
99 



i-.S 
5.0 



4.9 4.7 

<• 'Id* 



1.4 1.4 



5.0 S.O 
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•\ • Appendix A 



GLOSSARY stfv.tf 1 '••>-:^^ : f'' 



College-Level, Academic Skills 

The communications and computation skills adopted by the State Board of 
Education in |Wie ^ v vi l'i 



CLAST 



The College-Level Academic Skills Test , a test developed by the Department 
of Education pursuant to Section 229.551(3)(k) , Florida Statutes to measure 
student achievement of the skills listed in Rijle 6A-40.31, FAC. 



CLASP 



The College-Level Academic Skifrljli ffiroject , a cooperative faculty activity 
maintained to advise the Department of Education and ensure continuing 
faculty contributions to decisions concerning, skills to.be expected of 
col.leg4> students, the ways in which the skills are tested, atQl the 
utilization of test results. 



itij 

Chairperson of CLASP v 



A faculty member who is designated by the Department and who serves 
on a part-time basis to direct and coordinate activities of the College- 
Level Academic Skills Project. 



The CLASP Of f ice of the DOE 



A unit in the Office of the: Deputy Commissioner for Special Programs 
through which tt\e Comnd^s'^bner lot Education exercises responsibility for 
■ CLAST. """**" • 

The Statewide TeatAAdministrator (ST A) 

The- contractor assigned responsibility ;xor functions involved in the . 
development and administration iof CLAST. 

' '. • *■"' . ' > . ' ' . V --. . ' 

Institutional Test Administrator (IT A) 



r > The officer in each community college, state university, or other 
participating instltutiop who is assigned responsibility for 
coordinating all 'activities related to the administration of CLAST , 
in that institution. 
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- Appendix B 

. - ■■ LAWS RELATING TO CLAST 

EX ' \ 

Florida Statutes f 

Section 229.053 General Powers of State Board 

(2) The board has the following duties: 

(d) To adopt for public universities and community colleges, and from 

time to time modify, minimum and uniform standards of coll^B g^ l eve l ; 

communication and computation skills generally associated with success- 
ful performance and progression through the baccalaureate level; and to 
approve tests and other assessment procedures which measure student 
achievement of those skills . ... 



Section 229.551 Educational Management 




(3) As a part of the system for educational accountability the department 
# shall: * 

(i) Maintain for the information of the State Bo'ard of ' Education and 
the Legislature a file of data compiled by the Articulation Coordinat- 
ing Committee to reflect achievement of college-level communication 
and computation competencies by students in state "universities and 
community colleges. gfc' ^ 

(j) Develop or contract for, and submit t;o the State Board of. 
Education for Approval, tests which measure and diagnose student 
achievement of college-level communication and computation skills. \ 
Any test? and related documents developed shall be exempt from the 
provisions of s. 119.07. The commissioner shall maintain statewide . 
responsibility for the administration of such tests and may assign , 
administrative responsibilities for the tests to any public univer-' 
sity or community college. The state board, upon recommendation of^the" 
commissioner, is authorized to enter into contracts for such services 
beginning in one fiscal year and continuing into the next year which 
are paid from the appropriation for either or both fiscal years. 

i 

Section 240.239 Associate of Arts degrees; issuance ' " 

(3) An Associate of Arts^degree shall not be granted unless a student 
• has successfully completed minimum requirements for college-level 
communication and computation skills adopted by the State Board of 
Education and a^fininnim of 60 academic semester hours or the equiv- 
alent, with hot less than 36 of the semester hours in general educa- 
tion courses such as communications, mathematics, social sciences, 
humanities, and natural sciences.- 
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Section 240.233 Universities; admission of students 

(5) Effective August 1, 1984, rules o| the State Board of Education 
shall require the use of scores on tests of college-level communi- 
cation and computation skills provided in s. 229.551 as a condition 
for admission o£> students to upper division* instructional programs 
from community-colleges, including those Who have been awarded Asso- 
ciate of Arts degrees. Use of such test scores as an admission require- 
ment shall extend equally and uniformly to students enrolled in lower 
divisions of the State University System and to transfer students from 
other colleges and universities. Effective August 1, 1982, the tests 
shall be required for community college students seeking admission to 
upper division instructional programs in the State University System. 
The use of test scores prior to August 1,^1984, shall ^ limited to 
student counseling and curriculum improvement. 



Section 240.319 Community college district boards of trustees; duties and 
powers ■ • " . * 

(3) Such rules and procedures for the boards of trustees include, but 
are not limited to- the following: 

' (r) Effective August 1, 1984, each board of trustees shall require the 

use of scores on tests for college-level communication and computation* 
skills provided in s. 229.551 as a condition for graduation' with an 
, Associate of Arts degree. Usfe of- test score's prior to August 1, 1984, 
sj^kll be limited to student counseling and curriculum improvement. 

Section 119.07 Inspection and examination of records; exemptions 

(l)(a) Every person who has custody of public records shall permit the 
records •"to be inspected and examined by any person desiring to do so, 
at reasonable times, under reasonable conditions, and under supervision 
by the custodian of the records or his designee. The custodian shqll 
furnish copies or certified copies of the records upon payment of fees 
* * as prescribed by law or, if fees are not prescribed by law, upon 

payment of the actual cost of duplication of the copies. Unless other- 
wise provided by law, the fees to be charged for duplication of public 
records sha^L be collected, deposited/and accounted for in the manner 
prescribed for other operating funds of the agency* 

(3)(a) All public records which a&e presently provided by law to be 
confidential or which are prohibited from being .inspected by the 
public, whether by general or special law, shall be exempt from the 
provisions of subsection (1). - 
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Section 120.52 Definitions .-As used in this (Administrative Procedure) act 

(1 A)' '"Rule" means each agency statement of general applicability that 
implements, interprets, or prescribes law ot policy or describes the 
organization, procedure,, or practice requirements of an agency and 
includes any form which imposes any requirement or solicits any infor- 
mation not specifically required by statute or by existing rule. The 
term also includes the athendment or repeal of a rule. The term does 
not include: 

« (e) Any tests, test scoring criteria, or testing proce-, 
dures relating to stu dent assessment which are developed - 



or administered by the Department of Education pursuant 
to s. 299.57, s. 232.245, s. 232.246, or s. 232.247 or 
any other statewide education test Required oy, law. 



Flori^Administrative Code 



6A-10.31 CojL^ege-level cbmmunication and computation skills. The 
communication and Computation skills identified herein, pursuant to Section , 
229.053(2)(d), Florida Statutes, are associated with successful perforaanc^ of 5 
students in college programs through the baccalaureate level. / ; • " 

(1) The following fkiii^ category ^pled as x;0g^ 

level ;ComlmlnicatiQO;6kill#^\^^y' l '' *Y---J^$?i . ' ' '&!•"'* 

4 (a) Reading ^th^iiterkl comprehension includes all of ;the following ; ;yy 4 

skills: 
. 1. 

2, 
, 3. 
(b) 
skills: 
1. 
2. 
3. 
4. 
5. 
6. 
Z. 
8. 
(c) 
skills: 
1. 
2. 
3. 
4. 



Recognizing main ideas in a given pastfttg&T 
Identifying supporting details* 

Determining meaning of words on the basis of context. 

Reading with 'critical comprehension includes all of the following 

Recognizing the author 1 s purpose. 

Distinguishing between statement of fact and statement of opinion. 
Detecting bias. 
Recognizing author 1 s tbne. 

Recognizing explicit and implicit relationships within sentences. 
Recognizing explicit and implicit relationships between sentences. 
Recognizing valid arguments. 
Drawing logical 'inferences and conclusions. 

Listening with literal comprehension includes all of the following 



Recognizing main ideas. 
Identifying supporting details. 
Recognizing explicit relationships among ideas. 
Recalling basic ideas and details. 
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(d) Listening with critical comprehension includes all of the following 
skills: 

r 1. Perceiving the speaker's purpose. 

2. Perceiving the speaker's organization of ideas and information. 
3* Discriminating between statements of fact ancj statements of opinion* 
— 4. Distinguishing between emotional and logical arguments. 
. 5. Detecting bias. 

6. Recognizing the speaker' sT attitude, v 

7. Synthesizing by .drawing logical inferences anjd conclusions . 

8. Evaluating objectively. " ' . 

9» — R ecalli ng th e a rgu m ent s a n d ide ntifying the imp lica t io n s. _ — 

(e) Composing units of discourse providing ideas and information suitable 
for purpose and audience -includes all of the following skills: 

1. Selecting a subject which lepds itself to expository writing. 

2. Determining the purpose for writing. 

3. Limiting the .subject to a topic which, can be developed within the 
requirements of time, purpose, and audience. 

4. Formulating a thesis statement which reflects the piirpose. 
5* Developing the thesis s tat eaten t by all of the following: 

a. Providing adequate support which reflects the ability to distinguish 
between generalized and concrete evidence. — r 

b. 'Arranging the main ideas and supporting details in an organizational 
pattern appropriate to the expository purpose. 

c. Writing unified prose in which all supporting material is relevant 
to the thesis statement. 

d. Writing coherent prose, providing effective transitional devices which 
clearly reflect the organizational pattern and the relationships of 
the parts. 

(f ) Transmitting ideas and information in effective written language which 
conforms to the conventions of standard American English Includes all of the 
following skills: 

1. Demonstrating effective word choice by all of the following: 

a. Using words which convey the denotative and connotative meanings 
required by context. 

b. Avoiding slang, jargon, cliches, and pretentious expressions. 

c. Avoiding wordiness. • 

'2. „ Employing conventional sentence structure by all of the following: 

a. Placing modifiers correctly. 

b. Coordinating and subordinating sentence elements according to their 
relative importance. 

c. Using parallel expressions for parallel ideas. 

d. Avoiding fragments, comma splices, and fused sentences. 

3. Employing effective sentence structure by all of the following: 
a; Using a yairiety of sentence patterns. . ; 

b. Avoiding unnecessary, use of passive construction. - 

c. Avoiding awkward constructions. " 

4. Observing the conventions of standard American English grammar and 
usage by all 4 of the following: 

a. Using standard verb forms. 

b. Maintaining agreement between subject, and verb, pronoun and 
antecedent. 
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c. Using proper case forms. ' ; ■ - 

&•* Maintaining a consistent point of view. 

5. Using standard practice for spelling, punctuation, and capitalization. 

6. 'Ravi sing, editing, and proofreading Anits of written discourse to 
assure clarity, consistency, and conformity to the. conventions of 

0. , }, V 8 tandar^ American English. 

<g) Speaking involves composing the message, providing ideas* and 
information suitable to topic, purpose and audience which includes all of the 
following skills: : 

1. Determining^ the purpose ot- the oral discourse. ~ " ; ' H . ? y- 

2. Choosing a topic and restricting it according to purpose and audience* 
!:. 3 .Fulfilling the pur im> s e by t}t^ following: . • x ' 

.Formulating * thesis stsLt'^ni.;-^ / , ']•< * \ < : 

b. Providing adeq^ttf ^ 
c Selecting a suitaW*:^ 
.d. Demonstrating!^*^ 
* e. Providing ^fflctive ^transitions. V i" >. 

(h) Speaking 4^ the mtssag^^ping, oral delivery skills 

suitable {o the audience and the occasion by all of tm.^^f^ng skills: 

IV Employing vocal variety in rate, pitch, and intensity. , - 

2. Atticulating clearly., "V. 

3. Employing the level of American EnjrfU^h appropriate to the designated 
audience. ' •* ■ u 

4. Demonstrating lonverbal behavior ^wfr Left supports xhe verbal message 
with eye contatt and appropriate ^atfulre, gestures, facial expres- 
sions, and body^Taovemerit8. ^ * 

(2) The following skills, by designated category, are defined as college- 
level computation skills : v '• / 

(a) Demonstrating mastery of ali of^the^p^Lfciwing arithmetic algorithms: 

1. Adding, subtracting, mult^JrV^ 
numbers. . %! -r ■• \. 

2. Adding, subtracting, mul!t Iplying ati||||yi^ing r po si tive rational 
numbers in decimal f <dr^ ; &l , Jy^jHP^ . 

(b) Demonstrating^ 8 te^^^ geometric and 

u 



measurement- algoritbafsT 

1. Rounding/ measurements to of the measuring 
" devices>ed. • . .^gS^-^ * 

2. Calculating distances, English-metric 
conversions when given ^5$^ 

(c) Demonstrating mastery ol^i^^ : 
N ■ 1. Adding, subtracting, mult^ 

2. Applying the oi^er-of-opci|t^i^^ involving 

nuntoers, and variables, ./y^ ' 

3. Using scientific notation ^ ot 
very small measurements. V V^/'^ m . 

4. Solving linear equations an^ljaEc^^ 

5. Using given formulas to compu^Cf^^ 



are not involved. '*X*:t\ i: \\% 



"••'V -JxV't>'Vl *v*r l. v, « «?.-.• 
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(d) Demonstrating mastery of all of the following statistical algorithms, 
ncluding some from probability: 

1. Identifying information contained in bar, line, and circle graphs. 

2. Determining the mean, median, and mode of a set of numbers. J\ 

3. Selecting the sample space associated with an experiment, *V 

(e) Demonstrating mlst!«3*-of logical-reasoning algorithms by deducing 
:acts of set inclusion or set non-inclusion from a diagram. 

(f) Demonstrating understanding of arithmetic concepts by all of the 
following skills: 

1. Recognizing the meaning of exponents. • ,, 

2. Recognizing the role of the base number in determining place ~ 
value in the base-ten numeration system anid in systems that are 

. patterned after it. • V 

3. Identifying equivalent forms of positive rational number^ 
involving decimals, percent s, and fractions,. 

4. Determining the order relation between magnitudes. 

(g) Demonstrating understanding of geometric and measurement; concepts 

by all of the following skills: ^ - \/*i' r ' y .. ' 'j 

1. Recognizing horizontal, vertical, parallel, perpendicular, and inter-, 
secting lines. \ 
. ■ 2. Identifying relationships between angle measures. 

3. Classifying simple plane figures by recognizing their properties. 

4« Recognizing similar triangles .and their properties. 

5.. identifying appropriate types of measurement for geometric objects. 

(h) Demonstrating understanding of algebraic concepts by all of the' 
following skills: . 

1. Recognizing and using properties of operations. 

2. ; Determining whether a particular number is among the solutions of 4 
,>:, . giyfin. equation or inequality. 

^||i|^nt^3ring ' regions of the coordinate plane which correspond; to : , 

^conditions. ;\ : '■" - f ^\;^> 

ting understanding of statistical concepts including 
the following skills: " 
I? the normal curve and its properties. 

{. samples that are representative of a given population v 
the probability of a specified outcome in an experiment. 
Eing understanding of logical-reasoning concepts by all of 



Recognizing istatements andT conditions of proportionality and 
Variation. 




the fol: 



ying simple and compound statements and their negations < 
draining equivalence or non-equivalence of statements. 
Drawing logical conclusions from data. 
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4. 'Recognizing that an argument may not be valid even though its 

conclusion is true 
5* Distinguishing fallacious arguments from non-fallacious ones. 
6. Recogq£ziftg proof by contradiction. 

(k) Demonstrating understanding of computer-technology concepts by all of 
the following skills: ' — 

1. Identifying characteristics of tasks which computers perform well. 

2. Identifying the human functions necessary to utilize computers. 

3. Identifying possible abuses of computer use. x 

t±i — Generalizing and selecting applicable gene r alizations In a rithmetic by 

both of the following skills: ( 

1. Inferring relations between numbers in general by examining particular 
number pairs. 

2. Selecting applicable properties for performing arithmetic 
, calculations. 

(m) Generalizing and selecting applicable generalizations in geometry and 
measurement by both of the following skills: . f 

1. Inferring formulas for measuring geometric figures. 

2. Selecting applicable formulas for computing measures of geometric 
, figures* ' " ' , ; 

(n) Generalizing and selecting applicable generalizations in algebra by 
t^pth of the following skills: * 

1. inferring relations among variables. « 

2. Selecting applicable properties for solving equations and 
inequalities. 

(o) Generalizing and selecting applicable generalization in statistics, 
Including probability, by inferring relations and making accurate predictions 
from studying particular cases. 

(p) Generalizing and selecting applicable generalizations in logical 
reasoning by both of the following skills: ■ m ' 

1. Inferring valid reasoning patterns and expressing them with * 
variables. , * ■ ■ * ■ 

2. Selecting applicable rules for transforming statements without 
affecting their meaning. ^ N 

(q) Demonstrating proficiency for solving problems i%|fee area of 
arithmetic by both of the following skills: 

, 1. Solving real-world problems which do not require the use of variables. 
2. Solving problems. Jthat involve the structure and logic of arithmetic 

(r) Demonstrating proficiency for solving problems in the area of geometry 
and' measurement by both the following skills t. - ^ 

1. Solving real-world problems involving perimeters, areas, volumes of 
geometric figures. ^ %' 

2. Solving real-world problems involving. the Pythagorean property. 

(s) Demonstrating prof i£ffency for solving problems in the area of algebra 
by both of the following skills: 

1. Solving real-world problems involving the use of variables, aside from 
commonly used geometric formulas. 

2. Solving problems that involve the structure and logic of algebra. 
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' -i ' • '/ : : • . • •• . : 

(t) Demonstrating proficiency for solving problems in the area of 
statistics,, Ihcluding probability for both of the following skills? 

1. Solving real-world problems involving the normal curVe. 

2. Solving real-world problems involving probabilities . 

(u) Demonstrating awareness of the ways in which logical reasoning is 
used to solve problems by drawing logical conclusions when facts warrant them* 

(3) The Articul^tioff'Cooordinating^OTmittree shall file with the 
Commissioner and the State Board, on or before Novembe^ 30 of each odd numbered v 
year, its recommendations for changes, if any, in the above definitions of . 

college-level communication and computation skills* ^_ z : _ 

Specific Authority 229. 053(l)(2)(d) PS. Lav Implemented 229.053 (2)(d), 
.229.551 (3)(g) FS. History - New 9-3-81, Amended 5-25-82. 



6A-10.314 Assessment of Student Attainment of College-Level 
Communication and Computation Skills. / 

(1) The skills in'Rule 6A-10.31, FAC, shall be used by thefArticulaticm 
Coordinating Committee as the basfs for the development of specifications for 
teat items. : - . 

(2) The specifications shall be used by the Articulation Coordinating 
Committee as the basis for the development of tests and other assessment 
procedures to measure the levpl of student attainment of the skills. 

(3) The College-Level Academic Skills Test, an achievement test developed 
by the Iflbpartment pursuant to Section 229.551 (3)(h), Florida Statutes, to 
measure the level of attainment of college-level communication and computation 
skills listed in Rule 6A-10.31, FAC, is approved and designated for use in . < — . 
community Colleges and state universities for the purposes specified in Sections 
240.319(3)(c) and 240.325(3), Florida^Statutes and Sections 4, 5, and 6 of * 
Chapter 82r 180, Laws of Florida* 

(4) A person required to take the College-Level Academic Skills Test who 
has a record pof physiological disorder(s) which substantially impairs that 
person's visuki^auditory , manual or speaking abilities or who has a record of a 

aing disability shall be deemed to have satisfied any requirement to present 
re on any subtest which has not been modified in administration so as best 
sure that the performance of the person on t$xe subtest accuAtely reflects 
the person's achievement of the skill being measured, rather than the person's 
impaired abilities. The -tgst, modifications may include but are not limited to 
the following: # ■ ; >■ /, V. 'V ' . ; . 

(a) , Flexible scheduling. The person may fee administered a subtest during 
several brief sessions, so long as all testing is completed on the test 
administration date. " / \ 

(b) Flexible setting. The person may be administered a subtest 
Individually or in a small group setting by a^ proctor rather than in a classrpom 
or auditorium setting. 

(c) Recording of answers. The person may mark answers in a test booklet, 
type the answers by machine, or indicate selected answers to a test proctor. 
The proctor may then transcribe the person's responses onto a\machine-scorable ' 
answer sheet. ^ 
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- ; ■ ; ■ ' . ■« ^* 

(d) Revised format. The ^ print booklet, a Braille 

test booklet, or a magnifying -de$$i$if \\ 

ludit;oty aids. The persaji may u$e audio devices. 'A tape recorded 

versio^^^ appropriate portioha^f tn^test may be used, along with a prjtfted'.^-; ' :5 y 

copy* Appropriate portions of the test may be read tt>;ithe student b^';*./' , ' 

narrator. * 1 *v .Vi?jv ? "*. ' ■ • * sj'/ 



■ ' ' . " ^ •A : -4\;':.,.r . • ' " 

6A-10.312 Minimum standards of college-level communication .^and 

computation skills. 7 : ~~ ""7" , V^V;^.- 

(1) The Commissioner shall approve procedures for establishing uniform 
standards of performance on the College-Level Academic Skills test and recommend 
the levels of attainment of the communication and coifoueation skills inclv^^^in 
Rule 6A-10.31, FAC, that are to be r<etquired o^^ijd^ts "to satisfy the standards 
of the State Board, which levels of attainment ^^itien^ approved by the State 
Board, shall constitute the minimum standards, of college-level communicatioli r and 
computation skills of the State Board. * ti' t 

(2) The Commissi'oner shall recommend changes in the mintoum-Standtfrds to 
JusJ^to changes in the level of attainment of comptinicatioh and imputation 
Ells Ming achieved by students in community colleges and state universities / 

id. to changes in the definition of the college-level skills included in Rule 
1-10.31, FAC. 

Specific Authority 229.053(l)(2)(d) FS. Law Implemented 229.053 (2)(d),"" 

f40. 233(5) FS., Sections 3 and 4 of Chapter 82-180, Laws of Florida. History - 

;w 9-3-81 , Amended 9-29-82 . . \. • 

6A-1 0*313 College-Level communication and computation skills in , y 
Community colleges. ^ 

(1) The communication and computation skills included in Rule 6A-10.31, 
FAfc, shall,, be taken into consideration by the respective district boards of 
trustees in the establishment of student performance standards for the awarding 
of associate degrees. N^associate of ^ts^iegree shall be awarded after the 
October, 1982 administr^dn of the College-Level Academic Skills Test to ' 
students who do not present scores earned on that tes/t or who do not satisfy* the 
requirements of Rule 6A-10. 311(4), FAC. Effective AiAjust 1, 1984, student 
scores earned on that test must satisfy the minimum standards of the State 
Board! f } 

\ (2) For purposes specified in Section 240. 319(3)(q), Florida Statutes, 
each district board of < trustees shall ' define the levels of attainment of the 
communication and computation skills defined in Ktile 6A=*Kl<31, FAC, which are 
associated with successful performance in college-pfedit programs in the 
respective community colleges. 



(4) The respective district boards of trustees s^all assure that all ^ 
students in college-credit programs have the opportunity v CO-.ecqui re the skills 
included in Rule 6A-10 f 31, FAC . ' \ ( 



(5) Prior" to AugMflt^iv i984, use made of student scores on the,- "• • r vV 
College-Level Academic ! i^ills Test by a community college shall be *l;i^ < V 
establishing eligibility?, fo^ the award of an associate of arts degre^-sti^fent 
coup8eling, and curriculu#Iimprov«nents. Prifcr to August 1, 1984, the, level of 
scored earned on, College-Level Academic Skills Test shall npt be used in any way 
to \dfetiy a* Student an associate of ar$i ^degree. , ■ r 

Specific Authority. 229.053 (l)(2)(d) FS. Law Implemented, 229. 053(2) (d), 
240.319(3)(c)(p)(q)(r) FS., Sections 4 and 6 of Chapter 82-180, Laws of Florida. 
H isto ry ^ ew^^^lr7^^nded-I077-82 : . — — ♦ f — •; — — — — 



6A-1& 314 \Co liege-Level c<^unl<?aKion and computation Qkill«;:ia ^flMte 
universities*,^ • . V/£ /' • • ~h ■ t* J. 

( 1) The" communication ^d'ebWputatton skills included in Ruler 6A-10 .31 , ; 
FAG, shall be taken into amount by each -^ai^mi^ersit^. awarding in associate 
of arts> degree in the- estaibiishmetit^ <if v student;Yite^^ the 
award of that degree; provided, however, that no associate of arts degrees shall 
be \ Swarded after the October 198i^dministration of the; Cbllege-Level Academic 
Skills *Test to students who do not present scores earned on that testr and 
provided, further, that beginning August 1, 1984, student scores on tt*£ test 
must satisfy the, minimum standards of the State Boaid. 

; . • .'v..'- ■ • . 

(3) Each state university with a lower division shall assure that, #L\ 
^students in college-credit programs have opportunity to acquire the .?W$J$v> 

included in Rule 6A-1 0.31, FAC. ^^: ;AV^ 

(4) Except as provided la Rule 6A*10. 314(5) , FAC, beginning ^ wi.th the , 
October 1982 administration of tti£>College-Level Academic Skills; Test, each 
SJtafee university shall require all ^ upper divisioit ;§tatus, 
'ipciuding students who were^dmi^Md;^ the university as freshme^pr 
sophomSres, to present scores whitittHiave been earned on the Colleger-Level 

academic Skills Test; 4 and for any term beginning on or after August 1, 1984, the 
admission of all students to upper division status shall require presentation of 
scores on the College-Level Academic Skills which* satisfy the minimum standards 
of the State Board. * v 

(5) Students required to present scores on the College-Level Academic 
Skills; ^e8t who have not had opportunity to take the test may be enrolled in a \ 
atat^iiniyersity provided that the period of such enrollment does not extend 
beyond* "the *nd of the semester during which the* test is next administered. 
Students who have not ^ttald opportunity to take the test shall include students 
who were .awarded an associate of arts degree from a public community college in 
Florida prio*> to Octofcer 1982,. students who are vtransf erring to a state 
fcniveraity from an institution at which the test is not administered, and 
students who were prevented for medical or religious reasons from taking the 
test when it was administered. ' * 
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" '"t':v" ([».)>' ^'fcior to August i, 1984, use made of student scores on the 
College-Level Academic Skills Test by any state university shall, be limited to 
establishing eligibility for admission to u^pper division status, student • 
counseling, and curriculum improvement. \?ri6fc to August 1, 1984, the l£vel of 
scores earned o^ College-Level Academic Skills Test shall not be used in any way; 
to deny a student an associate of arts degree, admission to upper division 
status or, admission to any upper division program. '..*'.■ :-V ' 

Spiec'ific Authority 229 .053; fa)(2)(d) FS. Law Dnpledented 22**053 (2)(d), a . 
240.233(5) FS^, 'Sectio ns' 3V% ' and 5, C ha pter 82-lflQ, fews of Flyxiida. Histor y 
- New 9-3-81, Amended 16-7-82. ■ 
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, APPENDIX C 



COLLEGE-LEVEt ACADEMIC SKILLS TEST 



"° Skills Included; in 1982-83 Forms 
I. /REApiNG*. \'\] * 



COMMUNICATION SKILLS 




A. Reading with ^literal Comprehension includes all of the following v 
^ skills: . , : " 

1. Recognizing main ideas in a given passage^ • , • r ; ^ 

2. Identifying supporting details * r 

3. Determining meaiyLng of words ^on th^basis df context ^-./.- ' v 

Reading with critical cpmprehension include? all" of, the following 
.skills: > ,. % ( , " « . " : ; . t c \> 

1. Recognizing tl\e author's purpose c- ;r .» ,v< *- . > 

2^ Distinguishing between statement -"'ox^fidjct 'and $"tateine[nt of opinion 
3. ' Tfetectinjj bias* . # . • "■ ■ > : ,' . t ■ v. 

4* Recognizing author's tone v.; ; ♦ ' , 

5. Recognizing explicit and impl'lcit relationships wifehin Sentences 
j&. .Recognizing explicit and implicit relationship* between sentences 
,7\ Recognizing valid arguments . 

8.^ v ^ra^rtng ltjg^c^ inferential and Conclusions ; -f 



II. WRITING 



A. Composing units of discourse providing ideas and information suitable 
fl ^iov-'^^Be [ -a^^^i^nce \Lncttides all of the following skills: 

r: \ ' .1.. ' Selecting a subject which lends itself to expository writing . 

;2. Determining the purpose for writing 
v = j.: I^LAi'tiog the subject to a to^ic which can be developed within 
y'-' \ fch* requirements of time, purpose, and. audience V , 
' 4.- Formulating a thesis statement which reflects' the purpose 
y5. * Developing the thesis statement b^ all of the following: 

a. P^^iding.r-id equate support which reflects tt\g ability to 
; 'V* distinguish between Generalized and concrete evidence . 

* . b. Arranging the main ideatf and supporting details in an organ- 

, 4 . ■-•• : ^>. izational pattern appropriate to the expository purpose 
" 4 ; ^ Writing unified prose/ in which all supporting material is, 
■". i relevant it o ithe thesis statement' . 

• • d. . Writing coherent |rose, providing effective transitional . 

devices which clearly reflect th^f organizational pattern and 
, -> : the relationships of the parts , " ■"- . . 
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&• Transmitting ideas and* information in effective written language which ^ 
conf ornis to "the conventions of standard American English includes all 
of th$ % following skills: , . * * \ \V : . # * 

V. '....* 4 

l.. v ^Demonstrating effective word choice by all of the. following:* 

:^'a. Using wordjS which convey the denotative and connotative, r -K 

, , meanings required by /context # v 

*' b. Avoiding' slang, Jargfrn, cliches, and pretentious impressions 

'c- Avoiding wotdiness , . , 

. 2. > Employing conventional aftaffeiice structure t>y all of the fo^lowring: 

-r-v ."V i ' ; • *" ' ■ 

a* Plaiclng modifiers correctly # 

' ,b. Coordinating and subordinating sentence elements according %p 

. vi- their relative importance ; y * v 

c. Using parallel .expressions for parallel ideas r 

d. " Avoiding fragments* comma splices, and fused sentences 

3. Employing effective sentence structure by all of the ^following r * 

a. Using a variety of sentence; patterns 

b. Avoiding unnecessary use of passive construction * 
c* ;Aybiding awkward constructions 

' #y." ' ** ■ • .:. ' • : "l 

4. Observing the conventions of standard. American English grammar 
and; usage by all of the following: ...... 



a. tfs4tlj5 : standard verb forms * 

%b« Maintaining. v agreement between subject and verb, pronoun and 
antecedent 

c. Using proper case forms 

d. * Maintaining a consistent point of view 

. • - . . ' . ; • - V > • , 

5* Using standard practice for spelling, punctuation, and 
> capitalization'; ( ] ' J 

6. Revising, editing, and proofreading units of written .discourse 
to assure clarity, consistency, and conformity to tfre convenr 
• " tions of standard American,iEnglish -.' ' * 

• • . •• •. ■ y ■ *, 

0 . . . * * 

COMPUTATION ' SKILLS ' • . 

!• ALGORITHMS ( . 

A. Demonstrating mastery of all of the following arithmetic algorithms: ^ 

•1$ Adding, subtracting, multiplying, and dividing positive rationale 

numbers ' * 
2- .Adding, subtracting, niijltiplying, and dividing positive rational 
numbers in decimal form * 
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Br Demonstrating mastery «oV all of tfie following geometrip and 
/ * Aeasurtmetft algorithms: 

ft Rounding measurements to the nearest given unit "of the measuring 
^device ^iaet ^ . 4 ' * 0 

Calculating disfrncfl, areas, and volumes including English- 
fc^Pmetric ^cot^vef sions when given J:he conversion units 

C. DeMrfBtx*ting.mastSry 'oWall of^the following algebraic algorithms: 

..•■■.•>.'■.>■■"■-* 
* Adding, subtracting, flultipijring, and dividing real numbers 
2. Applying the ordir-ofi^peratigns agreement to computations " 
, involving. numbers and variables 
V 3. Vising ^scientific nofcafctfli in calculations involving very large 
* or very small measurements 

4. Sotving linear 'equations and inequalities ■ 

5. Using given formulas to compute results, when geometric 

' " jaeasurjements are not involve.d # ■ 4 , 

D. Demonslrrating mastery ol ail of the following statistical algorithms 
including some •from probability: • * 

Identifying information contained in bar, line, and circle gr&ph 
I* ~ Determining the, mean, median, and mode of a sit of numbers 
3i Selecting" the sample epace a^ociated with an experiment 

E. Demonstrating mastery /of logical-re^sonihg algorithms by deducing 

of set inclusion or^et^ndn-incliision from a diagram* 

'concepts \ * ; 

A. Demonstrating understanding ot arithmetic concept* by all of the 
folloitfng. skills: . 

1. Recognizing the meaning of afcponfepfte 

2. Recognizing the role of the base number in determining place 
value .in the bfs^-ten numeration system and in systems thd% 

. are patterned after it * * . 1 X 

3. Identifying equivalent fon&s of positive* rational nuflfcers 
involving decimals, percents, arid fractions 

* 4. Determining the order relation between magnitudes • 

• . t ' $ * <t 

• B. Demoflhtratiny understanding of geoole trie* and meafur'eoent concepts 
by all of the fallowing §kills: : • 

1. Reqpgnizing h'orlzojtlf*!, vertical, parallel, perpendicular, and 

<U intersecting lines / v 
2s Identif ying, relationship^ between angle measure 8 
3... Classifying simple- plane figur*s,J>y* recognizing their propertie 
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4. -Recognizing similar triangles and their properties 

5* Identifying appropriate types' of measurement for geometric objects 

Demonstrating understanding of algebraic concepts by all of the 
following skills: 

1. Recognizing and using properties of operations * . 

2*. Determining whether a- particular number is among the solutions 

of a given equation or equality 
3* Recognizing, statements and conditions of proportionality and 

variation 

A» Identifying regions of the coordinate plane, which correspond to 
specified conditions , v. 

«# 

Demonstrating understanding of statistical concepts including 

probability by *11 of the following skills: 

. • • . . ■ . * * 

1. Recognizing the normal curve and its properties 

2. Recognizing samples that. are representative of a given population 

3. Identifying the probability of a specified outcome in an 
experiment 0 * 

Demonstrating understanding of logical-reasoning concepts by all 
of the following skills: 

1. 'identifying simple and compound statement and their negations 
2* Determining equivalence or nonequivalence of statements 

3. .. Dr fitting logical conclusions from datd 

4. Recognizing that an argument may not be valid even though its 
conclusion is true . - 

5. Distinguishing fallacious arguments from non-fallacious ones 
6* Recognizing proof by contradiction • 

■ .'*■» * •■ 

Demonstrating, understanding of computer-technology concepts by all 
of the following skills: 

. " • • • • f ■ • ■ - . '; ' ■ 

1* /.Identifying, characteristics of tasks which computers perform 

2* ' Identifying the human functions necessary to utilize computers 
3. Identifying possible abuses of computer use % • y 
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» , APPENDIX D 

College-Level Academic Skills Project Members 

The following individuals served in the Capacities identified during part ot all 
of the period 1979-83. \* 



Executive Committee 



x > 

Shelley S. Boone, Chairperson 

Department of Education . * 

Myron R. Blee Paul C. Parker' 

Division of Community Colleges . Board of Regents , 

t ■■*..■ 

Project Directors 

Margaret Maney fc „ 

Broward Community College 

* Paul D. Gallagher > Ernest R. Ross 

Florida Itxternational^University St. Petersburg Junior College 

CLASP Staff 

Myron R. Blee Linda F. "Tears 

Technical Advisory Committee 

^Jacab\G. Beard Thomas H. Fisher 

Florida State University Department of Education 

• , Sue {1. Legg 

University of Florida 

Measurement Consultants 

Jacob G* Beard ; Albert C. Oosterhpf 

Florida-State University Florida $tate University 

Statewide Teat Admi nistrator * o 

' 1 . . *■ — " r 

Jeaninne N. jtebb, Director 
Office of Instructional Resouxyes 

University of Florida t 

Standing Committee»on Student Achievement 

Robert Stakenas, Chairperson * V 

Florida State University 

~ - v 

Paul D. Gallagher * Ernest R. Ross ; j 

Florida International University 1 St. Petersburg Junib* College 

. - ■ • I * / . ' • . ? ' 9 ' - • - v 

Elizabeth Cobb Noojin Walker . ft v 

Florida junior College at Jacksonville Pensacola Junior ColJj£ge 



Aubrey Perry . Levester Tubbs r ? f 

Florida A & M University \ University of Central Florida 
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State Level Task Force 



* Communications 

Marian Bashinsk^> r Chairperson 
Florida State University 

Madelyn W. Barnes 

University" of Central Florida 

Richard Earl Carroll x 
Chipola Junior College 



Computations 

Etta Mae Whitton^ ^CJiairperson 
'Tallahassee Comnrunity College 

Thomas Deal • 

Indian River Cpnufoinity College 

Gwendolyn K. Huxaptoey 

Florida A & M University 



Elaine Greenwood 

Valencia Community College 

Ward Hellstrom 

University of Florida 

Sylvia Holladay 

St. Petersburg Junior College 

Elaine Ludovici 

Miami-Dade Community College 

Bernlce A. Reeves 

Florida A & M University 

Carets Rose Russell 

Florida Junior College at 
Jacksonville 

John Sisco 

University of South Florida 

Johnie Blake 

Florida A & M University 



' William Klrshner 

Florida Atlantic University 

Coy Edwin McCllntock ^ , 
Florida International .University 

o Charles Miles 

Hillsborough Community College 

Sea ton Smith, Jr • 

University of West Florida 

Mary L. Spencer 

Seminole Community College 

Jean ^ankaster 

Woodham H.S. , Pensacola 

James Johnson 

Miami "-Edison Senior H.S. 

Annette O'Brien 
Winter Park H.S. 



Rosa Calve t Gonzales 

Stananhan H.S/, Ft. Lauderdale 

Wilhelmina Boysen 

Tate H.S., Gonzalez 



Debra Gloomis 

HiilsborflttKh H.S., Tampa 



>r^|^ti 



Consultants to the Task Force 



Mary Ellen Grasso 

Broward Community College ^ 
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Jeffrey Lukenbill 

Mi ami -Dade Community College 



ITEM SPECIFICATIONS WRITERS 



Marian Bashinski **" 
Florida State University 

Etta Mae Whit ton 

^allaha&see Community College 

Coy Edwin McCllntock . ■ ■ i % . * . :•■ 

Florida international UniveridLty; 



Ernest R. Ros« 

St. Petersburg Junior College, 

Linda Fears. 
CLASP Office 

Maurine Jones 
: &ASP Office 



^41bert/c: j^^riiof 
Mek^emen^ . Cc^tdjta^t ; 
Fl6rida ^taH diversity; 



ITEM SPECIFICATioNS RE^nWERg 



Members of Task Forces on Communications a?d Computation 
Members of Standing Committee on Student Achievement 



Communication Specialists 



Reading 



i 



Marian Bashinski 

Florida State University 



Writing 



John Bencich 

Brevard Community College 



D'elphenia Carter 

Florida Jr. College 



Lee DeCesare , 
^ Hillsborough Community College 



Jean English 

Tallahassee Community College 

Bruce Gutnecht 

University of North Florida 

Carol Hawkins 

Polk Community College 



Mary Faraci t 

Florida Atlantic University 

Helen Gilbart 

! St. Petersburg Junior Cdllege 

Sydney Harrison 4 ' 

Edison Community Colleger- 



Phyllis Luck 

Broward Community College 

Grover Mathewson 

Florida International University 



Wayne Losaho 

University of Florida 

'<"•.* 
Delia Paal 

Valencia Community College 



Marion Perez 

. Florida Keys Community College 



Louiae Skillings 

Miami-Dade Community College 



, ITEM SPE CIF ICATIONS |^3B^lti8 . / ;.t>^): j 1 4 
Co&nunicatioris S|gclgljj^ 
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Reading 

Margie Presley 

Daytona Beach Community College 
■ * ■ * 

Barry Russal 

Palm. Beach Junior College 

Frank Sexton 

Pensacola Junior College 



^V: 1 ^ College / 

: ^Y^ College' 



: vv ; J St^ *etetdburg C 



Community College 



Laura Wiggins 

Manatee Junior College 



: J'^"v ! *.- » ^w^bosi^-Walto'n Junior College 
• MgasuremkEfc Specialists 1 * " ' . 



• t ' V-J. <Jtti*fcris>ity of. South Florida ^ 



Univer^itjr "of Plbfilia 

Charles Dziuban V : f > * 

University of Central Florida 

William Ypunkin \V-7"-' . r . „ .... , 

Florida International. University £ "^^"■VvV^^.'Siiorida A & M Unlveriii^ i ■ 



; diversity of Florida*? 

J " '^\S;;;^brj$y,>Perry 



V ' r , CompirtatipnL Sj 



r BtS 



Donald Abraham 1 ' * » 

St. Pe fer^bur g > Junior Co 1 lege , 

Dennis Alber r \ * 

Palm Be^ch Junior College 

: * ' "\ '.r. • ; * .' 

Le«( Armstrong 1 f 

University of Central Flbri^tf; 



^ ': V-T- .v ; ; -forttr Florida Junior 




e- 



Maria Maspons \t?'^0^ 
Mikmi-Dade Community Cqll^ev'V^; 

Micfiael J. Hears %\'ffi' m > 
Manatee Junior College \ i V v\: 
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Solomon. Badger ■ V./.'\. -K':^ 

Florida Jr. College ■ ^; 

Ben-Ami ^Braun 4 f / ; . 

.St. Petersburg juniot 'College 

Ruth Buries .-V;* ; <: ' ; r. : ^ 

. Edison Community Co Xieg^ ■ 

Eleanor Dean 



Tallahassee C<nnfllunit;y. College 



; Charles Nelson 

University of Florida 

Mike Palmer / 

Pensacola junior College 



4 



Demoris Rhodes i 
'Hillsborough Community Qplleg^. 

Willie Roberts v v ^ . 

Florida A & M University :•' "V 
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ITEM Sg&MFlCATIONS REVIEWERS 
Computation Specialists (continued) 



Margaret Esser 

Hillsborough Community College 

John Hartwell 

Polk Community College 

Mary Holton g - ■ 

Central Florida Community College 

i 

Martha Jjjrdan 
^ Okaloosa-Waltoh Junior College 



James Slifker - 

Florida International University 

Winona Sorrells 

Valencia Community College 

Bob Walsh ■ - 

Gulf Coast Community College - 

Jay Wishau 

v t ( Semipple Community College 



Sandra Kirk .? j 

University of North Florida , 

5 * Measurement Specialists 



James Beadle J > 

University: ; ^i-:<^ttl(l--^9r£da v - 

Margueri te 'Culp : ■ , j; * ' : Hfc- : ' 
Seminole Community College 

Robert" Drummorid * 

Hillsborough Community College 



Richard Fitzgerald 
v .* ,; ^Florida Keys Community College 

v ^ Htfa Mid^atigh ' 

' Hi 1 lriboroagh •' Commun i ty College 

John Scerba - 

Miami -rDade Community College . 



Reading : 



. i *' 



• ITEM DEVELOPMENT TEAMS 

.Contractor : Office of Instructional Resources 
University of Flo rida 
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.APEENDDJ E 



Item Review Fond 
, : Computation Items 
Content and Measutjement Review 



% 



ft: 



Skill 



tern Number 



JNeeds. no revision 
Needs revision 



Totally unacceptable 



1. 


Does the item conform to the Specifications in content 

and format? 1 }' ' , . > 

• . . ; .... 


yes 


no 


? 




Directions? 


yes 


ho 


? 




Stimulus? , ■ 

"'if • , 


yes 


i-' - 
no 


.? ' 




■ * . Options? ■ " 


yes 


no 




•2V. 


• * ' ■ f 

Does the item measure the specified skill? 


yes , 


% no 




3. 


Is the level of difficulty appropriate? 0 


• *j 
yes 


no 


? 




Are the directions clear, ^concise and <kjmplete? 


yes 


* n&V.. 


? ; 




Is the item* dear? 


> ye s 


no 


' . •»' 


6, 


boes t hi* i fern fcdnform to . standard grammar and usage? 


y£s 


■ . »i ■ 
no - 


? 




Does the item follow mechanical cbnventions 
(punctuation, capitalization, spelling)? 


yes 


nd"? 


? ' 


* 

8. 


Is the item independent of other items? ■ • 


yefe 


no 


?' '•' 


9* 


Is th^question easily related to the diagram provided 
(if applicable)? 


yfes 


no. 


••;•? NA. 


10. 


Is the diagraA.clear^nd appropriate (if applicable)? 


/' ye is j 


ao v ' 


'•• ? •" MA 


11. 


Are the options 0 * 

logically ordered? 


jes 


rib 






*;/ . syntactically alike? 


yes 


no 


? 




logically parallel? 


yes 


no 


' ? /■ 




approximately the same 


yes 


, n0 
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; ^ ; Computation It ems : ; . -\ V 

V Content and Measurement Review (continued) 

124 Is the item free of unintended clues to the correct ■ 

answer? [■■ ... # / '. ^ ; v "- ;• ;,v-. , ■« " .. c yea . no ? 

13. ; Is t;he item free of tricky expressions or options? yes no ? 



J. i 



14. Is theni tfenv free of extraneous Or confusing material? yes ' . no » ? 

15. .^.tto-'i.tynr '^ree of pther obvious flaws -in °\ . ■ , 
construction? \ ? V * / ' 3 yes .no ? 

*-V6* -\For'&t^ not being . , . 

assessed: la the arithmetic computat^ 



reasonable length and- complexity? ; yes no ? 

17. . Is the^ keyed option the, cartect response? : .yes no ? 

18. ; Is the keyed option the only correct response? yes np ? 

19. Is the correct answer too obvious 'and too obscure? yes no ? 

20. Are the iiicor^ept options jspod distractors? yes no 
description of problemCsJandyor suggested revision(8): r 



■ s ■■ e-' 
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■A* 



6r 




lip- 



CIAST-Item Review Form 
V Computation Items 
JUas Review 



Item Number 



Skill 



Needs no 'revisiop 



Jteeds revision ; 
JTo t al ly unaccepfcabj^ 



Does the item contain any information that could be 
seen as* of fenstve to any group? . [If "jeer check the 
group(s) that may be affected.] 



male/ female % 



racial* 



/ 

■ ; / 

_so ci o-e c^ojomi c 



"JVe.i no ? 



4 cultural 



'religious 



ethnic 



age 



Jhandif capped > 
other C 



id-. 

v • 



Does the item include 91: imply any /stereotypic 



^ depiction of any group? ; 
. m aljp/ female 



racial 



cultural^ 



JSthnic\ 



, '■ f'fi&es tHjfe^item portray any grfoup ad degraded -in any 



) • , nale/ female 



racial 



cultural 





spcio-ecoriomi c 



V 



yes no '? 



*/ h andicapped 
other ( 



* *' ». 



socio-economic 



jreJgional 
^religious' 



* yes no ? 

. a 



/ 



T * 
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CIAST Item Review Fbrm 
-Computation-Items — 



Bias R*rtew (continued) 



4. Does the item contain clues or information that could 
be seen to work to the taenef it^>r ^detriment %of any 
group? 

male/ female | p ci o-e conomi c 



racial " . reg^Lot^ll 



^cultural ^\ r eligious * ^ 
ethnic h andicapped 
age other ( ) 



5. Does the item contain any group-specific language or 
vocabulary (e.g., culture-re ia ted expressions,, slang; 
or expressions that may be unfamiliar to examinees 

• of . either. sex or of a particular age;? 



Explanation of any items marked "yes" and suggested 
revision(s) : 



f £ C||S^ Item Review^Form 

■ |leading Passages & 

— 



9 



Passage 



tent Reviewer- 



Meeds no revision 



v Needs revision 



1. Poes theiTeaditig level of the passage appear to be 
.equivalent to that of a standard college text? 

« > ' $ # 

2. Does the pa#sag€ conform- toT the specification? 

; « * > • * 

« 3. Does the passage tlbnform to standard usage 

^vocabulary f« sentence struAure, etc.)? - If no, 
but acceptable becfat^e *<9f context, please indicate 
below • & 4 ^ 

$ 4^ Does the passage folifow 'mechanical^Dnvention^ 
0 (punctuation, capitalization, spellitfe)ff £ 

t 5. Is the passage clear (i.e.^'is f rc^ of extraneous v 
a or confuding material and is logically organised)? 

6. Does flfre p^fcsage rfeem s^lAble for* developing * 
'items for *he skills itsted? • ^ ' % 

A 



Totally unacceptable 



Description of <$roblem*(s) and/69 suggested revision: 



yes no 



yes ,no 
ft 



*yes no 
}£s no 



yes 



yes no 



no 1' 



' 3 



K 4 



4 ' 
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CLAST Item Review Form 



Ew j j Topics 



V 



Needs no revision 



Content and Measurement Review 



Topic Nunfber 



1. Will every examinee be able to respond to the topic? 

2. Does the topic contain any vocabulary or language 
likely to be unfamiliar to examinees? ^ 

3* Dqes the topic lend' itself to expository writing 
(rather tfhan narrative)?- 

'''•.'"'* , - 

4. Can examinees develop an essay of the required 
length from the topic? 



5. Does the topfc require the student to have any 

* specialized knowledge or -to have fiad any unique^ 
% experience? 

Is the topic broad enough to allow for several 
* possible responses? r 

* , ■ ■> * 

7 . Will the topic allow the examinee sufficient 

•ppoftuoity to 'give evidence of organisational 

. # Skills (e.g., show relationships between parts, 

provicie, supporting details,, us* effective 

. , fctransitiondi Jievicef)? ) * 

■I*. ' i ■ . < ' ,« 

Will the topic be- likely to work to the advantage or 
detriment o5 eithe^ -sex or to any racial, oultural 
« ethnic, apcio-economi^p, regional, religious, age, 
.handicSpped, or other grotip? c 

description of the problea(s) and/or tugget 



Needs revision 



Totally unacceptable- 
yes no ?. 

yes ijp ? 



r«Tl«lon(«): 



* 
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yes 
yes 

© ; 

ye 8 
yes 



' n 9 

V 

Jno, 



no 



tio 



yes 



yes 



no 

i 

no 



o 



•a 
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